-- Logs begin at Tue 2022-10-04 07:59:24 UTC, end at Tue 2022-10-04 09:08:56 UTC. -- Oct 04 08:31:44.786100 dv-cinder-859447-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Oct 04 08:31:44.797767 dv-cinder-859447-2-smb devstack@keystone.service[88116]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 4 08:31:44 2022] *** Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: nodename: dv-cinder-859447-2-smb Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: machine: x86_64 Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: clock source: unix Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: pcre jit disabled Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: detected number of CPU cores: 4 Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: current working directory: / Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: detected binary path: /usr/bin/uwsgi-core Oct 04 08:31:44.799826 dv-cinder-859447-2-smb devstack@keystone.service[88116]: your processes number limit is 47680 Oct 04 08:31:44.800542 dv-cinder-859447-2-smb devstack@keystone.service[88116]: your memory page size is 4096 bytes Oct 04 08:31:44.800542 dv-cinder-859447-2-smb devstack@keystone.service[88116]: detected max file descriptor number: 2048 Oct 04 08:31:44.800542 dv-cinder-859447-2-smb devstack@keystone.service[88116]: lock engine: pthread robust mutexes Oct 04 08:31:44.800542 dv-cinder-859447-2-smb devstack@keystone.service[88116]: thunder lock: enabled Oct 04 08:31:44.800542 dv-cinder-859447-2-smb devstack@keystone.service[88116]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 04 08:31:44.800542 dv-cinder-859447-2-smb devstack@keystone.service[88116]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 04 08:31:44.838639 dv-cinder-859447-2-smb devstack@keystone.service[88116]: Python main interpreter initialized at 0x562e6e2b29c0 Oct 04 08:31:44.838639 dv-cinder-859447-2-smb devstack@keystone.service[88116]: python threads support enabled Oct 04 08:31:44.838639 dv-cinder-859447-2-smb devstack@keystone.service[88116]: your server socket listen backlog is limited to 100 connections Oct 04 08:31:44.838639 dv-cinder-859447-2-smb devstack@keystone.service[88116]: your mercy for graceful operations on workers is 90 seconds Oct 04 08:31:44.838981 dv-cinder-859447-2-smb devstack@keystone.service[88116]: mapped 403077 bytes (393 KB) for 2 cores Oct 04 08:31:44.839056 dv-cinder-859447-2-smb devstack@keystone.service[88116]: *** Operational MODE: preforking *** Oct 04 08:31:44.839309 dv-cinder-859447-2-smb devstack@keystone.service[88116]: *** uWSGI is running in multiple interpreter mode *** Oct 04 08:31:44.839309 dv-cinder-859447-2-smb devstack@keystone.service[88116]: spawned uWSGI master process (pid: 88116) Oct 04 08:31:44.839493 dv-cinder-859447-2-smb systemd[1]: Started Devstack devstack@keystone.service. Oct 04 08:31:44.840044 dv-cinder-859447-2-smb devstack@keystone.service[88116]: spawned uWSGI worker 1 (pid: 88127, cores: 1) Oct 04 08:31:44.840377 dv-cinder-859447-2-smb devstack@keystone.service[88116]: spawned uWSGI worker 2 (pid: 88128, cores: 1) Oct 04 08:31:44.842241 dv-cinder-859447-2-smb devstack@keystone.service[88116]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 04 08:31:49.175393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:31:49.175393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: from cryptography.utils import int_from_bytes Oct 04 08:31:49.176204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:31:49.176204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: from cryptography.utils import int_from_bytes Oct 04 08:31:49.176317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:31:49.176317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: from cryptography.utils import int_from_bytes Oct 04 08:31:49.176731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 04 08:31:49.176731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: from cryptography.utils import int_from_bytes Oct 04 08:31:49.231536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:31:49.231745 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:31:49.231839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 04 08:31:49.231932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] command line args: [] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:31:49.232014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 04 08:31:49.232197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:31:49.232815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] command line args: [] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 04 08:31:49.232920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ================================================================================ {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:31:49.233006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 04 08:31:49.233177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ================================================================================ {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 04 08:31:49.233262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] admin_token = **** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.233420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] config_dir = [] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.233497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] admin_token = **** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.233607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.233690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] config_dir = [] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.233772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] config_source = [] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.233844 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.233954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] debug = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.234038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] config_source = [] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.234153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.234459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] debug = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.234459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.234735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.234840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.234945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.235059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.235163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.235296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.235406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.235535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.235646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] list_limit = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.241328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] list_limit = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.241530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] log_config_append = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.241619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] log_config_append = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.241697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.241774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.241846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] log_dir = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.241925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] log_dir = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.241997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] log_file = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] log_file = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.242941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243562 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243649 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.243945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] publish_errors = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] publish_errors = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.244929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] standard_threads = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] standard_threads = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.245960 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246111 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] use_journal = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] use_journal = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] use_json = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] use_json = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] use_stderr = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] use_stderr = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] use_syslog = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246796 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] use_syslog = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246873 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.246950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 04 08:31:49.247029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.247171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.247249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.247314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.247384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.247453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.247663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.247753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.247832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.247909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.248531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.248624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.248697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.248767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.248837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.248912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.248989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249148 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.249982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.250949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.251978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252122 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.252855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253625 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.253928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254261 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.254956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255362 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.255997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.256951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257157 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257721 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.257934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.258022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.258096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.258282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.258550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.258631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.258692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.258760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.258889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.258976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259050 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.259968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260508 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.260876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.261953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.262108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.262224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.262349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.262432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.262587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.262670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.262821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.262900 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.263058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.263137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.263296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.263375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.263604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.263688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.270220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.270421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.270499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.270571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.270643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.270714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.270799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.270875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.270947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.271955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.272937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.273026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.273108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.273181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.273305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.273393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] auth.external = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.273468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] auth.external = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.273539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.273610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.273689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] auth.password = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] auth.password = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] auth.token = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] auth.token = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.274954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] credential.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] credential.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.275969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276191 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.276967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277327 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277686 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.277983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] federation.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] federation.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278784 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.278926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.279005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.279078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.279696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.279777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.279846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.279908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.279990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.280935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281223 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.281832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.282942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.283978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.284092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.284234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.284342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.284575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.284665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.284822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.284910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.285056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.285232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.285313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.285541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.285620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.285778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.285866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.286028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.286114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.286276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.286402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.286511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.286735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.286872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.287058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.287122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.287197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.287411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.287580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.287708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.287836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.287968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.288124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.288259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.288447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.288573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.288737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.288861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.288989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.289126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.289268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.289397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.289528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.289658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.289787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.289919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.290072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.290197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.290356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.290480 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.290605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.290737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.290862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.291071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.291202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.291327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.291451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.291618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.291799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.291927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.292050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.292173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.292303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.292461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.292587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.292713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.292837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.292972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.293128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.293225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.293301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.293372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.293467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.293625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.293730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.293876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.293957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.294127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.294207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.294376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.294468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.294625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.294711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.295401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.295493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.295692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.298863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.298863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.299901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300106 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300400 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.300996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301762 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] resource.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.301991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302867 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.302939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] role.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] resource.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] role.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.303961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304508 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.304945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] role.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305096 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] role.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.305752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.306325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.306414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.306577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.306656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.306822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.306901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.307070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.307158 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.307317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.307398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.307568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.307654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.307818 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.307907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.308061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.308140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.308317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.308403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.308570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.308659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.308771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.308956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.309036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.309195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.309275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.309445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.309527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.309695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.309775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.309940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.310020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.310183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.310263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.310447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.310531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.310684 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.310764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.310924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] token.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.311006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.311164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.311243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.311399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.311479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.311657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.311740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.311890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.311970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.312143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.312223 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.312438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.312589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.312673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.312746 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.312860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.312949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.313096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.313176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.313328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.313408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.313564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] token.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.313653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.313799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.313878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.314044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.314131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.314280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.314368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.314535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.314615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.314778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.314862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.315013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.315092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.315258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.315346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.connection = **** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.315499 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.315592 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.315768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.315853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.316006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.316100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.316243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.316323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.316476 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.316555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.316713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.316801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.316955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.317035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.317195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.317275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.317433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.317521 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.317669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.317755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.317935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.318074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.connection = **** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.318255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.318330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.318480 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.318557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.318630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.318702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.318845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.318926 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.319077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.319159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.319320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.319400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.319581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.319663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.319750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88128) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:31:49.319826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.320053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.320288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.320531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.320767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.321019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.321256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.321502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.321733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.321973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.322209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 04 08:31:49.322378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88127) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 04 08:31:49.353000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.353231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.353462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.354041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.354274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.354497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.363592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.363712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.391614 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.391777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.391865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.391943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.447018 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.447335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.507714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.507944 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.508424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.508729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.671065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.671282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.671496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.671740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.671826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.671958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.672056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.672173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.672258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.672416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.672637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.672854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.695309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.695566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.695656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.695796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.695881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.696020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.696105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.696240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.696324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.696456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.696548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.696670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.696751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.696891 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.708274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.708828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.723452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.723612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.723694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.723815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.723928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.724030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.724151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.724235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.724370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.724455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.724587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.724673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.724803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88127) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.724887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88128) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 04 08:31:49.741353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.741549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:31:49.741886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.742017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.742101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:31:49.742230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:31:49.742348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.742574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.742661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.742778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 04 08:31:49.742859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.743057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.743138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.743323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.743614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.743881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.752661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.752939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.753212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.753497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.753620 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.753905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.754182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.754471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.760401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.761494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.763255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.764079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.764399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.764683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.764966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.765048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.765225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.765308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.765495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.765580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.765767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.765849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.766037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.766126 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.766308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.766390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.766576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.766657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.766850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.767125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.767402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.767702 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.789413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.790800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.790910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.791129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.792382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.792616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.795817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.796105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.796386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.797302 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.797591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.797883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.802640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.802930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.804246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.804542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.808742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.809039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.809328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.809617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.809897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.810171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.810490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.810640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.810721 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.810794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.811042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.811333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.811641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.815027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.815027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.815027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.825897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.826705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.828423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.828717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.830485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.832572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.833664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.833956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.835873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.836178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.838062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.840478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.841127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.844348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.844840 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.845139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.845423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.845704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.845980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.846327 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.847578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.847883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.848175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.849457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.849457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.849457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.861818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.862104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.862374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.862638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.864811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.865108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.865385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.865656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.869436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.870970 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.872522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.872623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.872796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.874119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.875436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.875668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.875755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.875951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.876035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.876298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.876695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.878693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.878990 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.879284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.879600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.879997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.887717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.888002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.888290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.889093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.889484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.889765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.890053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.891737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.892028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.892312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.892604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.893019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.893317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.893603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.905847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.908758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.909632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.911765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.912558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.913194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.914652 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.914940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.915348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.915445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.917059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.918577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.918862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.919277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.922269 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.923120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.925754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.925988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.926387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.926676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.926954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.927259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.930145 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.930549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.931101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.931433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.934973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.935267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.935599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.939304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.939624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.939914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.942404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88127) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.942692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.942976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.943257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.943547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.943821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.944094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.944378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.944651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.944943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.945214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.945475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.945738 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.946013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88127) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.946816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88128) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 04 08:31:49.947143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.947433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.947743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.948028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.948317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.948599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.948892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.949176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.949464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.949823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.950053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.950349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.950632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88128) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 04 08:31:49.980977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562e6e2b29c0 pid: 88127 (default app) Oct 04 08:31:49.984076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d68e-cc71-4101-94ec-93f66df49d6a None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:31:49.984364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d68e-cc71-4101-94ec-93f66df49d6a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:31:49.984641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2d68e-cc71-4101-94ec-93f66df49d6a None None] PATH_INFO: `/v3` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:31:49.985870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562e6e2b29c0 pid: 88128 (default app) Oct 04 08:31:49.988805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Tue Oct 4 08:31:49 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:31:57.597145 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764935cf-8230-48f4-aaf5-75f1c109ec9c None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:31:57.597543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764935cf-8230-48f4-aaf5-75f1c109ec9c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:31:57.597699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764935cf-8230-48f4-aaf5-75f1c109ec9c None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:31:57.602042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:31:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:31:57.607254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:31:57.607720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:31:57.607839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:31:57.678788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: INFO dbcounter [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] Registered counter for database keystone Oct 04 08:31:57.698319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG oslo_db.sqlalchemy.engines [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88127) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:31:57.704460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writer thread running {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:31:57.879586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG passlib.handlers.bcrypt [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88127) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 08:31:57.879915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG passlib.handlers.bcrypt [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88127) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 08:31:57.938240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:31:57.939855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:31:58.063164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:31:57 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 457 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 04 08:31:58.482277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764935cf-8230-48f4-aaf5-75f1c109ec9c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:31:58.551757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: INFO dbcounter [None req-764935cf-8230-48f4-aaf5-75f1c109ec9c None None] Registered counter for database keystone Oct 04 08:31:58.572963 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG oslo_db.sqlalchemy.engines [None req-764935cf-8230-48f4-aaf5-75f1c109ec9c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88128) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 04 08:31:58.579146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writer thread running {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 04 08:31:58.697296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764935cf-8230-48f4-aaf5-75f1c109ec9c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:31:58.702210 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c263b64a-a722-4ead-91b1-8969a372c159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:31:58.702848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263b64a-a722-4ead-91b1-8969a372c159 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:31:58.703132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263b64a-a722-4ead-91b1-8969a372c159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:31:58.703407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c263b64a-a722-4ead-91b1-8969a372c159 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:31:58.715705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263b64a-a722-4ead-91b1-8969a372c159 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:31:58.767051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c263b64a-a722-4ead-91b1-8969a372c159 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 08:31:58.767335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c263b64a-a722-4ead-91b1-8969a372c159 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:31:58.776746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Oct 4 08:31:58 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:31:58.783275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:31:58.799741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dba20-908c-48fc-ab1b-a7e69df20aa9 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:31:58.804184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c5843-01f7-4494-a5ae-8207696d5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:31:58.805294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c5843-01f7-4494-a5ae-8207696d5e32 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:31:58.805580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c5843-01f7-4494-a5ae-8207696d5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:31:58.805853 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c5843-01f7-4494-a5ae-8207696d5e32 admin admin] PATH_INFO: `/v3/projects/13165a830a7a4a8b85146503c9ccfc33` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:31:58.807768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c5843-01f7-4494-a5ae-8207696d5e32 admin admin] RBAC: Authorizing `identity:get_project(project_id=13165a830a7a4a8b85146503c9ccfc33)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:31:58.860572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: WARNING keystone.common.rbac_enforcer.enforcer [None req-765c5843-01f7-4494-a5ae-8207696d5e32 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 04 08:31:58.860931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c5843-01f7-4494-a5ae-8207696d5e32 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:31:58.865440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Tue Oct 4 08:31:58 2022] GET /identity/v3/projects/13165a830a7a4a8b85146503c9ccfc33 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:00.985731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dedfe-c632-4a84-a3bb-71937918ee67 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:00.986239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dedfe-c632-4a84-a3bb-71937918ee67 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:00.986320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889dedfe-c632-4a84-a3bb-71937918ee67 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:00.990679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:00.996019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d77e62-1d01-4346-8d53-4343e08c1775 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:00.996381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d77e62-1d01-4346-8d53-4343e08c1775 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:00.996592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d77e62-1d01-4346-8d53-4343e08c1775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:01.016825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-34d77e62-1d01-4346-8d53-4343e08c1775 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:01.018352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-34d77e62-1d01-4346-8d53-4343e08c1775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:01.026179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 04 08:32:01.293410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dedfe-c632-4a84-a3bb-71937918ee67 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:01.305290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889dedfe-c632-4a84-a3bb-71937918ee67 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:01.309707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fea1b5-3a4e-4cd5-a549-53671f456bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:01.310299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fea1b5-3a4e-4cd5-a549-53671f456bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:01.310579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fea1b5-3a4e-4cd5-a549-53671f456bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:01.310851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fea1b5-3a4e-4cd5-a549-53671f456bc2 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:01.318815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fea1b5-3a4e-4cd5-a549-53671f456bc2 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:01.320577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fea1b5-3a4e-4cd5-a549-53671f456bc2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:01.329636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Tue Oct 4 08:32:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:32:01.335091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d77e62-1d01-4346-8d53-4343e08c1775 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:01.344087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d77e62-1d01-4346-8d53-4343e08c1775 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:01.348431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983607b4-53e6-4c7f-90e2-3b72ca8585ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:01.349057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983607b4-53e6-4c7f-90e2-3b72ca8585ae admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:01.349344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983607b4-53e6-4c7f-90e2-3b72ca8585ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:01.349621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983607b4-53e6-4c7f-90e2-3b72ca8585ae admin admin] PATH_INFO: `/v3/users/6544ace43e54452fa059337ba0542217` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:01.350933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983607b4-53e6-4c7f-90e2-3b72ca8585ae admin admin] RBAC: Authorizing `identity:get_user(user_id=6544ace43e54452fa059337ba0542217)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:01.352792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983607b4-53e6-4c7f-90e2-3b72ca8585ae admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:01.354294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Tue Oct 4 08:32:01 2022] GET /identity/v3/users/6544ace43e54452fa059337ba0542217 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:03.601441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7086f6-feed-469b-9c5c-d7e7a7600431 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:03.601864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7086f6-feed-469b-9c5c-d7e7a7600431 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:03.601982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7086f6-feed-469b-9c5c-d7e7a7600431 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:03.603318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:03.608648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96c817-284e-4eee-8c5e-eede5f947dca None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:03.609073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96c817-284e-4eee-8c5e-eede5f947dca None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:03.609217 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96c817-284e-4eee-8c5e-eede5f947dca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:03.625253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d698a-13ae-4224-910c-d67c153e42dc None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:03.625541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d698a-13ae-4224-910c-d67c153e42dc None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:03.625816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d698a-13ae-4224-910c-d67c153e42dc None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:03.627116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:03.627713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-bf96c817-284e-4eee-8c5e-eede5f947dca None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:03.628972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bf96c817-284e-4eee-8c5e-eede5f947dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:03.632017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2033e8-9a93-4b83-81af-2c477983ad09 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:03.632294 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2033e8-9a93-4b83-81af-2c477983ad09 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:03.632564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2033e8-9a93-4b83-81af-2c477983ad09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:03.673807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG passlib.handlers.bcrypt [None req-3f2033e8-9a93-4b83-81af-2c477983ad09 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88128) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 04 08:32:03.674193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG passlib.handlers.bcrypt [None req-3f2033e8-9a93-4b83-81af-2c477983ad09 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88128) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 04 08:32:03.712221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:03.724164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-3f2033e8-9a93-4b83-81af-2c477983ad09 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:03.725745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3f2033e8-9a93-4b83-81af-2c477983ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:03.824388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:03.977914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96c817-284e-4eee-8c5e-eede5f947dca None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:04.003704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:04.078939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96c817-284e-4eee-8c5e-eede5f947dca None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:04.091832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2033e8-9a93-4b83-81af-2c477983ad09 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:04.112453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8678ba-7de3-44ca-826d-a0c24d17e1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:04.113070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8678ba-7de3-44ca-826d-a0c24d17e1e7 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:04.113355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8678ba-7de3-44ca-826d-a0c24d17e1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:04.113635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8678ba-7de3-44ca-826d-a0c24d17e1e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:04.178787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8678ba-7de3-44ca-826d-a0c24d17e1e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:04.180293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8678ba-7de3-44ca-826d-a0c24d17e1e7 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:04.190086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2033e8-9a93-4b83-81af-2c477983ad09 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:04.192334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:04.203372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:04.237989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb77922-2e1f-4bd1-ab00-f20ff4b409de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:04.237989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb77922-2e1f-4bd1-ab00-f20ff4b409de None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:04.237989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb77922-2e1f-4bd1-ab00-f20ff4b409de None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:04.237989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb77922-2e1f-4bd1-ab00-f20ff4b409de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:04.244739 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb77922-2e1f-4bd1-ab00-f20ff4b409de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-eeb77922-2e1f-4bd1-ab00-f20ff4b409de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:04.254423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:04.255399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:04.256370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 8/14] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:04.262316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb77922-2e1f-4bd1-ab00-f20ff4b409de None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:04.299210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 7/15] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:04.304852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8678ba-7de3-44ca-826d-a0c24d17e1e7 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:04.371901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb77922-2e1f-4bd1-ab00-f20ff4b409de None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:04.407565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ea61b-04e1-43c8-bfc7-3dc9f60138a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:04.408546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ea61b-04e1-43c8-bfc7-3dc9f60138a9 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:04.409051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ea61b-04e1-43c8-bfc7-3dc9f60138a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:04.409390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ea61b-04e1-43c8-bfc7-3dc9f60138a9 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:04.410131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ea61b-04e1-43c8-bfc7-3dc9f60138a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:04.410505 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ea61b-04e1-43c8-bfc7-3dc9f60138a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:04.412045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ea61b-04e1-43c8-bfc7-3dc9f60138a9 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:04.419530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8678ba-7de3-44ca-826d-a0c24d17e1e7 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:04.424989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 9/16] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:04.430727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ea61b-04e1-43c8-bfc7-3dc9f60138a9 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:04.445825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:04.459402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:04.459900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4589e-7802-4833-ad19-934bbf5b3bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:04.460574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4589e-7802-4833-ad19-934bbf5b3bae None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:04.460855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4589e-7802-4833-ad19-934bbf5b3bae None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:04.461117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb4589e-7802-4833-ad19-934bbf5b3bae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:04.473483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4589e-7802-4833-ad19-934bbf5b3bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:04.474949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb4589e-7802-4833-ad19-934bbf5b3bae None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-afb4589e-7802-4833-ad19-934bbf5b3bae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:32:04.495334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:04.496414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:32:04.497371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:32:04.497371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:32:04.497371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:04.498839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 8/17] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:04.504767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4589e-7802-4833-ad19-934bbf5b3bae None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:04.540545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ea61b-04e1-43c8-bfc7-3dc9f60138a9 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:04.575663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2927dc-1078-4370-9bc8-e0cd0dcc2709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:04.576333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2927dc-1078-4370-9bc8-e0cd0dcc2709 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:04.576616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2927dc-1078-4370-9bc8-e0cd0dcc2709 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:04.576888 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2927dc-1078-4370-9bc8-e0cd0dcc2709 None admin] PATH_INFO: `/v3/users/6544ace43e54452fa059337ba0542217` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:04.578405 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2927dc-1078-4370-9bc8-e0cd0dcc2709 None admin] RBAC: Authorizing `identity:get_user(user_id=6544ace43e54452fa059337ba0542217)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:04.579968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2927dc-1078-4370-9bc8-e0cd0dcc2709 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:04.581557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 10/18] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:04 2022] GET /identity/v3/users/6544ace43e54452fa059337ba0542217 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:04.586885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2927dc-1078-4370-9bc8-e0cd0dcc2709 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:04.609620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb4589e-7802-4833-ad19-934bbf5b3bae None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:04.642145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11acac-60f9-4ad6-9891-60b3da7edd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:04.642760 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11acac-60f9-4ad6-9891-60b3da7edd7f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:04.643029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11acac-60f9-4ad6-9891-60b3da7edd7f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:04.643353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f11acac-60f9-4ad6-9891-60b3da7edd7f None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:04.644032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11acac-60f9-4ad6-9891-60b3da7edd7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:04.644335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11acac-60f9-4ad6-9891-60b3da7edd7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:04.645711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f11acac-60f9-4ad6-9891-60b3da7edd7f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:04.662373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 9/19] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:32:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:04.682834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:04.695026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2927dc-1078-4370-9bc8-e0cd0dcc2709 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:04.733043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c03cf-bb12-4afc-9085-18e26b968b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:04.733695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c03cf-bb12-4afc-9085-18e26b968b87 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:04.733979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c03cf-bb12-4afc-9085-18e26b968b87 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:04.734255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c03cf-bb12-4afc-9085-18e26b968b87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:04.735448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c03cf-bb12-4afc-9085-18e26b968b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:04.736930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c03cf-bb12-4afc-9085-18e26b968b87 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:04.738539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 11/20] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:04.744549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11acac-60f9-4ad6-9891-60b3da7edd7f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:04.781470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:04.853068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f11acac-60f9-4ad6-9891-60b3da7edd7f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:04.887446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84687e54-83c9-4aa1-b82b-b29cbba9c4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:04.888102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84687e54-83c9-4aa1-b82b-b29cbba9c4b4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:04.888390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84687e54-83c9-4aa1-b82b-b29cbba9c4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:04.889197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84687e54-83c9-4aa1-b82b-b29cbba9c4b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:04.889922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84687e54-83c9-4aa1-b82b-b29cbba9c4b4 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.domain.id=default, user.id=6544ace43e54452fa059337ba0542217) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:04.890239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84687e54-83c9-4aa1-b82b-b29cbba9c4b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:04.891798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84687e54-83c9-4aa1-b82b-b29cbba9c4b4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:04.898881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 10/21] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Oct 4 08:32:04 2022] GET /identity/v3/role_assignments?user.id=6544ace43e54452fa059337ba0542217&scope.domain.id=default&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:07.151230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cda064-0cc2-48aa-97f6-62bbbedb84ac None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:07.152290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cda064-0cc2-48aa-97f6-62bbbedb84ac None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:07.152783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cda064-0cc2-48aa-97f6-62bbbedb84ac None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:07.154368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 12/22] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:07.159879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97291adb-7ef4-497c-9fe1-7b96b146d2c0 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:07.160722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97291adb-7ef4-497c-9fe1-7b96b146d2c0 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:07.161213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97291adb-7ef4-497c-9fe1-7b96b146d2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:07.188630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-97291adb-7ef4-497c-9fe1-7b96b146d2c0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:07.190209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-97291adb-7ef4-497c-9fe1-7b96b146d2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:07.287768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 11/23] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:07.401638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3470d-6a92-444e-bdff-c3a21e7c96cd None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:07.402247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3470d-6a92-444e-bdff-c3a21e7c96cd None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:07.402723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3470d-6a92-444e-bdff-c3a21e7c96cd None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:07.404326 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:07.409472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4695f7a-aec1-4b76-9c3d-512888cb1375 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:07.410003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4695f7a-aec1-4b76-9c3d-512888cb1375 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:07.410495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4695f7a-aec1-4b76-9c3d-512888cb1375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:07.434867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d4695f7a-aec1-4b76-9c3d-512888cb1375 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:07.436915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d4695f7a-aec1-4b76-9c3d-512888cb1375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:07.465803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:07.527242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 12/25] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:07.670352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce7a63-e95b-4b7f-9fea-b6e7e67722d4 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:07.670965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce7a63-e95b-4b7f-9fea-b6e7e67722d4 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:07.671441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce7a63-e95b-4b7f-9fea-b6e7e67722d4 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:07.673153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 14/26] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:07.679194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7b6c-1120-4251-ab4d-c0c686e569cb None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:07.679539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7b6c-1120-4251-ab4d-c0c686e569cb None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:07.679800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7b6c-1120-4251-ab4d-c0c686e569cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:07.711671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-388c7b6c-1120-4251-ab4d-c0c686e569cb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:07.712934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-388c7b6c-1120-4251-ab4d-c0c686e569cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:07.766395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce7a63-e95b-4b7f-9fea-b6e7e67722d4 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:07.817338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 13/27] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:07.818719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf31d0-3fdd-44f4-847f-5caeab4b659d None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:07.819017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf31d0-3fdd-44f4-847f-5caeab4b659d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:07.819292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedf31d0-3fdd-44f4-847f-5caeab4b659d None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:07.820552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 14/28] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:07.835390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd0c63-3c8d-4fa3-8916-56bc6f339fe5 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:07.835733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd0c63-3c8d-4fa3-8916-56bc6f339fe5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:07.836011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd0c63-3c8d-4fa3-8916-56bc6f339fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:07.863274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-bebd0c63-3c8d-4fa3-8916-56bc6f339fe5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:07.864584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bebd0c63-3c8d-4fa3-8916-56bc6f339fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:07.981550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce7a63-e95b-4b7f-9fea-b6e7e67722d4 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:07.991258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 15/29] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:08.000758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd0c63-3c8d-4fa3-8916-56bc6f339fe5 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:08.032249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:08.053662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413556f-0f68-44f3-b568-f7a86d0ee22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:08.055448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413556f-0f68-44f3-b568-f7a86d0ee22f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.055753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413556f-0f68-44f3-b568-f7a86d0ee22f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.057801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4413556f-0f68-44f3-b568-f7a86d0ee22f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.097452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413556f-0f68-44f3-b568-f7a86d0ee22f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:08.099218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4413556f-0f68-44f3-b568-f7a86d0ee22f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-4413556f-0f68-44f3-b568-f7a86d0ee22f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:32:08.131371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:08.132335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:32:08.133256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:32:08.133256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:32:08.133256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:08.139524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 15/30] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:08.147929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413556f-0f68-44f3-b568-f7a86d0ee22f None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:08.177839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd0c63-3c8d-4fa3-8916-56bc6f339fe5 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:08.184616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:08.215598 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadd19c-9f55-42c1-8137-7d41fc241936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:08.216255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadd19c-9f55-42c1-8137-7d41fc241936 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.217023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadd19c-9f55-42c1-8137-7d41fc241936 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.217294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadd19c-9f55-42c1-8137-7d41fc241936 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.229207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fadd19c-9f55-42c1-8137-7d41fc241936 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-1fadd19c-9f55-42c1-8137-7d41fc241936 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:08.236687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:08.237529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:08.238309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 16/31] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:08.248587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadd19c-9f55-42c1-8137-7d41fc241936 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:08.362501 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4413556f-0f68-44f3-b568-f7a86d0ee22f None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:08.394867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:08.430324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadd19c-9f55-42c1-8137-7d41fc241936 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:08.435293 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06322ec6-4ba3-4c74-a22d-2b783838a362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:08.435986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06322ec6-4ba3-4c74-a22d-2b783838a362 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.436266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06322ec6-4ba3-4c74-a22d-2b783838a362 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.436537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06322ec6-4ba3-4c74-a22d-2b783838a362 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.437189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06322ec6-4ba3-4c74-a22d-2b783838a362 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:08.437492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06322ec6-4ba3-4c74-a22d-2b783838a362 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:08.439079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06322ec6-4ba3-4c74-a22d-2b783838a362 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:08.459710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 16/32] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:08.460625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06322ec6-4ba3-4c74-a22d-2b783838a362 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:08.503454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a9af-1d72-4261-8564-cdb135702e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:08.504071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a9af-1d72-4261-8564-cdb135702e5c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.504355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a9af-1d72-4261-8564-cdb135702e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.504627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9a9af-1d72-4261-8564-cdb135702e5c None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.505298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9a9af-1d72-4261-8564-cdb135702e5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:08.505601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9a9af-1d72-4261-8564-cdb135702e5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:08.507284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c9a9af-1d72-4261-8564-cdb135702e5c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:08.522173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 17/33] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:08.523009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a9af-1d72-4261-8564-cdb135702e5c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:08.558888 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:08.585336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06322ec6-4ba3-4c74-a22d-2b783838a362 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:08.623771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ab40-f41a-4484-8b62-67af0ad7aab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:08.624395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ab40-f41a-4484-8b62-67af0ad7aab2 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.624677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ab40-f41a-4484-8b62-67af0ad7aab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.624952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e508ab40-f41a-4484-8b62-67af0ad7aab2 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.626067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508ab40-f41a-4484-8b62-67af0ad7aab2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:08.627013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e508ab40-f41a-4484-8b62-67af0ad7aab2 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:08.657237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c9a9af-1d72-4261-8564-cdb135702e5c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:08.695769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18e5a9-3497-4654-9762-de240d86be5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:08.696833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18e5a9-3497-4654-9762-de240d86be5a None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:08.697328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18e5a9-3497-4654-9762-de240d86be5a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:08.697829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18e5a9-3497-4654-9762-de240d86be5a None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:08.698706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18e5a9-3497-4654-9762-de240d86be5a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:08.700384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce18e5a9-3497-4654-9762-de240d86be5a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:08.712575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:08.834359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 17/34] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 08:32:08 2022] POST /identity/v3/roles => generated 225 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:08.835270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ab40-f41a-4484-8b62-67af0ad7aab2 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:08.967992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e508ab40-f41a-4484-8b62-67af0ad7aab2 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:09.015688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb479d4-2722-4d1a-850d-6fc173daf58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:09.016072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 18/35] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:32:08 2022] POST /identity/v3/projects => generated 301 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:09.016744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18e5a9-3497-4654-9762-de240d86be5a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:09.017128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb479d4-2722-4d1a-850d-6fc173daf58a None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.017676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb479d4-2722-4d1a-850d-6fc173daf58a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.018202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb479d4-2722-4d1a-850d-6fc173daf58a None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.019119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb479d4-2722-4d1a-850d-6fc173daf58a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:09.020995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb479d4-2722-4d1a-850d-6fc173daf58a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:09.025449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:09.111178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 18/36] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 08:32:08 2022] POST /identity/v3/roles => generated 219 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:09.112792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26625c-2b94-40c0-bc90-841ca1fc78b1 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.113084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26625c-2b94-40c0-bc90-841ca1fc78b1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.113443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f26625c-2b94-40c0-bc90-841ca1fc78b1 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.117063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 19/37] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:09.118476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d8f7-a525-4bdd-88de-ade14504c961 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.118810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d8f7-a525-4bdd-88de-ade14504c961 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.119184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e854d8f7-a525-4bdd-88de-ade14504c961 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.120631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 20/38] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:09.122153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4aee2-8a5a-4b79-b9df-0b1373e8eab0 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.123314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4aee2-8a5a-4b79-b9df-0b1373e8eab0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.123615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be4aee2-8a5a-4b79-b9df-0b1373e8eab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.147657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-4be4aee2-8a5a-4b79-b9df-0b1373e8eab0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:09.149361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4be4aee2-8a5a-4b79-b9df-0b1373e8eab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:09.163251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18e5a9-3497-4654-9762-de240d86be5a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:09.217656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7800914c-7d8d-4d70-be0e-5e5475163087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:09.218430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800914c-7d8d-4d70-be0e-5e5475163087 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.218617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800914c-7d8d-4d70-be0e-5e5475163087 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.218899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7800914c-7d8d-4d70-be0e-5e5475163087 None admin] PATH_INFO: `/v3/users/6544ace43e54452fa059337ba0542217` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.220258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800914c-7d8d-4d70-be0e-5e5475163087 None admin] RBAC: Authorizing `identity:get_user(user_id=6544ace43e54452fa059337ba0542217)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:09.222035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7800914c-7d8d-4d70-be0e-5e5475163087 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:09.224200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 19/39] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:09 2022] GET /identity/v3/users/6544ace43e54452fa059337ba0542217 => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:09.225638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99339359-6167-4db5-9685-a8de796d5679 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.225931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99339359-6167-4db5-9685-a8de796d5679 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.226218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99339359-6167-4db5-9685-a8de796d5679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.237624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 21/40] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:09.251358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-99339359-6167-4db5-9685-a8de796d5679 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:09.253739 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4aee2-8a5a-4b79-b9df-0b1373e8eab0 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:09.254002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-99339359-6167-4db5-9685-a8de796d5679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:09.332598 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:09.346919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 20/41] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:09.395191 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be4aee2-8a5a-4b79-b9df-0b1373e8eab0 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:09.421823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:09.434904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f222358-8899-4f62-8478-09a496faf83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:09.435636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f222358-8899-4f62-8478-09a496faf83c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.435925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f222358-8899-4f62-8478-09a496faf83c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.436203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f222358-8899-4f62-8478-09a496faf83c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.437350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f222358-8899-4f62-8478-09a496faf83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:09.438823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f222358-8899-4f62-8478-09a496faf83c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:09.440639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 22/42] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:09.446175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99339359-6167-4db5-9685-a8de796d5679 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:09.543970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f222358-8899-4f62-8478-09a496faf83c None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:09.554376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99339359-6167-4db5-9685-a8de796d5679 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:09.597538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69838561-406c-4720-81f7-2c801fcf9165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:09.598558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838561-406c-4720-81f7-2c801fcf9165 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.598989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838561-406c-4720-81f7-2c801fcf9165 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.599422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69838561-406c-4720-81f7-2c801fcf9165 None admin] PATH_INFO: `/v3/domains/default/users/6544ace43e54452fa059337ba0542217/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.601714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69838561-406c-4720-81f7-2c801fcf9165 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6544ace43e54452fa059337ba0542217, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:09.603425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69838561-406c-4720-81f7-2c801fcf9165 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:09.652114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f222358-8899-4f62-8478-09a496faf83c None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:09.685431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697e44d-5c5a-487b-98cb-b3a41e17e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:09.686040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697e44d-5c5a-487b-98cb-b3a41e17e0fb None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.686321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697e44d-5c5a-487b-98cb-b3a41e17e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.686599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697e44d-5c5a-487b-98cb-b3a41e17e0fb None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.687282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697e44d-5c5a-487b-98cb-b3a41e17e0fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:09.688697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697e44d-5c5a-487b-98cb-b3a41e17e0fb None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:09.702318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 21/43] 10.222.0.25 () {58 vars in 1361 bytes} [Tue Oct 4 08:32:09 2022] PUT /identity/v3/domains/default/users/6544ace43e54452fa059337ba0542217/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:09.703348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69838561-406c-4720-81f7-2c801fcf9165 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:09.746148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 23/44] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 08:32:09 2022] POST /identity/v3/roles => generated 223 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:32:09.761315 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:09.818837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69838561-406c-4720-81f7-2c801fcf9165 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:09.857971 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db55542c-6b7d-4708-b661-96f6df573e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:09.858645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55542c-6b7d-4708-b661-96f6df573e67 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:09.858936 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55542c-6b7d-4708-b661-96f6df573e67 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:09.859213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db55542c-6b7d-4708-b661-96f6df573e67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:09.860498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55542c-6b7d-4708-b661-96f6df573e67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:09.862066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db55542c-6b7d-4708-b661-96f6df573e67 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:09.863864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 22/45] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:09.869632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697e44d-5c5a-487b-98cb-b3a41e17e0fb None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:09.933160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:09.983246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697e44d-5c5a-487b-98cb-b3a41e17e0fb None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:10.016988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74750071-709f-47b1-825d-9db08fc36785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:10.017605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750071-709f-47b1-825d-9db08fc36785 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:10.018049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750071-709f-47b1-825d-9db08fc36785 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:10.018142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74750071-709f-47b1-825d-9db08fc36785 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:10.018789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750071-709f-47b1-825d-9db08fc36785 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:10.020248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74750071-709f-47b1-825d-9db08fc36785 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:10.137737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 24/46] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:32:09 2022] POST /identity/v3/projects => generated 312 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:11.885627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0381ea-4187-4a55-b023-c693b1e4e8db None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:11.886114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0381ea-4187-4a55-b023-c693b1e4e8db None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:11.886114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0381ea-4187-4a55-b023-c693b1e4e8db None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:11.887474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 23/47] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:11.892824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fd9a1-5012-4eb4-96e5-34bc2a659c1a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:11.893214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fd9a1-5012-4eb4-96e5-34bc2a659c1a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:11.893497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fd9a1-5012-4eb4-96e5-34bc2a659c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:11.912408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ff5fd9a1-5012-4eb4-96e5-34bc2a659c1a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:11.913578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ff5fd9a1-5012-4eb4-96e5-34bc2a659c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:12.080836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 25/48] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:12.288076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02586-b229-411f-b166-0d4228dee5ba None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.288367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02586-b229-411f-b166-0d4228dee5ba None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.288651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f02586-b229-411f-b166-0d4228dee5ba None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.290010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 24/49] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:12.295166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ed246-9ba8-43e5-82c2-938fa6da5908 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.295552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ed246-9ba8-43e5-82c2-938fa6da5908 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.295844 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ed246-9ba8-43e5-82c2-938fa6da5908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.319415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1d7ed246-9ba8-43e5-82c2-938fa6da5908 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:12.320640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1d7ed246-9ba8-43e5-82c2-938fa6da5908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:12.347358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f02586-b229-411f-b166-0d4228dee5ba None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.347556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:12.386904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 26/50] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:12.445636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f02586-b229-411f-b166-0d4228dee5ba None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.462323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:12.479147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed83fd-a472-41f4-8af5-680e6ff0abb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.479808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed83fd-a472-41f4-8af5-680e6ff0abb2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.480098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed83fd-a472-41f4-8af5-680e6ff0abb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.480375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed83fd-a472-41f4-8af5-680e6ff0abb2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.490670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed83fd-a472-41f4-8af5-680e6ff0abb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-40ed83fd-a472-41f4-8af5-680e6ff0abb2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:12.495528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:12.496346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:12.497134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 25/51] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:12.502385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ed246-9ba8-43e5-82c2-938fa6da5908 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.602052 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ed246-9ba8-43e5-82c2-938fa6da5908 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.634773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da976fe4-c618-4ef6-84b6-22c37a4ab675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.635383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da976fe4-c618-4ef6-84b6-22c37a4ab675 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.635705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da976fe4-c618-4ef6-84b6-22c37a4ab675 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.635981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da976fe4-c618-4ef6-84b6-22c37a4ab675 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.636658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da976fe4-c618-4ef6-84b6-22c37a4ab675 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:12.636985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da976fe4-c618-4ef6-84b6-22c37a4ab675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.638945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da976fe4-c618-4ef6-84b6-22c37a4ab675 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.646882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 27/52] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:12.652579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed83fd-a472-41f4-8af5-680e6ff0abb2 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.653802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da976fe4-c618-4ef6-84b6-22c37a4ab675 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.682634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:12.751032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed83fd-a472-41f4-8af5-680e6ff0abb2 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.753814 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da976fe4-c618-4ef6-84b6-22c37a4ab675 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.784707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27a6ee-73e8-472b-82cf-b48ee9298b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.785427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27a6ee-73e8-472b-82cf-b48ee9298b4f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.785782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27a6ee-73e8-472b-82cf-b48ee9298b4f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.786130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a27a6ee-73e8-472b-82cf-b48ee9298b4f None admin] PATH_INFO: `/v3/users/6544ace43e54452fa059337ba0542217` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.787392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27a6ee-73e8-472b-82cf-b48ee9298b4f None admin] RBAC: Authorizing `identity:get_user(user_id=6544ace43e54452fa059337ba0542217)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.787541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85105e0a-d8b5-4746-8db1-ac5bd5821f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.788082 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85105e0a-d8b5-4746-8db1-ac5bd5821f35 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.788365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85105e0a-d8b5-4746-8db1-ac5bd5821f35 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.788640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85105e0a-d8b5-4746-8db1-ac5bd5821f35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.789086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a27a6ee-73e8-472b-82cf-b48ee9298b4f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.789815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85105e0a-d8b5-4746-8db1-ac5bd5821f35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.790687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:12 2022] GET /identity/v3/users/6544ace43e54452fa059337ba0542217 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:12.791237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85105e0a-d8b5-4746-8db1-ac5bd5821f35 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.792829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 28/54] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:12.796041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27a6ee-73e8-472b-82cf-b48ee9298b4f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.798065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85105e0a-d8b5-4746-8db1-ac5bd5821f35 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:12.842493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:12.891051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:12.895179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a27a6ee-73e8-472b-82cf-b48ee9298b4f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.897558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85105e0a-d8b5-4746-8db1-ac5bd5821f35 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:12.928144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3869e3-6984-4ec6-939f-d3d019293127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.928839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3869e3-6984-4ec6-939f-d3d019293127 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.930437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3869e3-6984-4ec6-939f-d3d019293127 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.930437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3869e3-6984-4ec6-939f-d3d019293127 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.930437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3869e3-6984-4ec6-939f-d3d019293127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.932185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3869e3-6984-4ec6-939f-d3d019293127 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.932541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32795b09-c844-4504-b2f1-6e5d8ae36610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:12.933154 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795b09-c844-4504-b2f1-6e5d8ae36610 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:12.933441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795b09-c844-4504-b2f1-6e5d8ae36610 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:12.933718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32795b09-c844-4504-b2f1-6e5d8ae36610 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:12.933805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:12.934983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32795b09-c844-4504-b2f1-6e5d8ae36610 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:12.936436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32795b09-c844-4504-b2f1-6e5d8ae36610 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:12.940057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3869e3-6984-4ec6-939f-d3d019293127 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:13.026344 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 29/56] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Oct 4 08:32:12 2022] POST /identity/v3/projects => generated 298 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:32:13.038607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3869e3-6984-4ec6-939f-d3d019293127 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:13.054340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:13.075773 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0dc70-fb5a-4dc9-9409-55f718f677a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:13.076404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0dc70-fb5a-4dc9-9409-55f718f677a6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:13.076691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0dc70-fb5a-4dc9-9409-55f718f677a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:13.076969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0dc70-fb5a-4dc9-9409-55f718f677a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:13.077724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0dc70-fb5a-4dc9-9409-55f718f677a6 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.domain.id=default, user.id=6544ace43e54452fa059337ba0542217) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:13.078038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0dc70-fb5a-4dc9-9409-55f718f677a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:13.079555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0dc70-fb5a-4dc9-9409-55f718f677a6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:13.086314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 28/57] 10.222.0.25 () {56 vars in 1322 bytes} [Tue Oct 4 08:32:12 2022] GET /identity/v3/role_assignments?user.id=6544ace43e54452fa059337ba0542217&scope.domain.id=default&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:15.202884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abcdc-8c10-44a2-9c36-0c4760178fa3 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.203394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abcdc-8c10-44a2-9c36-0c4760178fa3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.203477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abcdc-8c10-44a2-9c36-0c4760178fa3 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.204806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 30/58] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:15.209997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546cee7-5308-4982-8a24-9e0a255d13c2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.210405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546cee7-5308-4982-8a24-9e0a255d13c2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.210563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546cee7-5308-4982-8a24-9e0a255d13c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.228121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-7546cee7-5308-4982-8a24-9e0a255d13c2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:15.229300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7546cee7-5308-4982-8a24-9e0a255d13c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:15.292121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 29/59] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:15.563489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9abcdc-8c10-44a2-9c36-0c4760178fa3 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:15.660651 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9abcdc-8c10-44a2-9c36-0c4760178fa3 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:15.693188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ad40-550d-4b70-a484-1daa45fe418c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:15.693806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ad40-550d-4b70-a484-1daa45fe418c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.694089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ad40-550d-4b70-a484-1daa45fe418c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.694364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ad40-550d-4b70-a484-1daa45fe418c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.695468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ad40-550d-4b70-a484-1daa45fe418c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:15.696931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ad40-550d-4b70-a484-1daa45fe418c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:15.698483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 31/60] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:15.704032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546cee7-5308-4982-8a24-9e0a255d13c2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:15.798744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546cee7-5308-4982-8a24-9e0a255d13c2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:15.807830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:15.831272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb7774-5822-4567-a9ce-c03190bbd96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:15.831848 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7774-5822-4567-a9ce-c03190bbd96c None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:15.832136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7774-5822-4567-a9ce-c03190bbd96c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:15.832413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb7774-5822-4567-a9ce-c03190bbd96c None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:15.833067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb7774-5822-4567-a9ce-c03190bbd96c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:15.834496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb7774-5822-4567-a9ce-c03190bbd96c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:15.915003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 30/61] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:15 2022] POST /identity/v3/users => generated 275 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:18.891423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fbc52-1149-4e32-b43e-08b4b113a84a None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:18.892384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fbc52-1149-4e32-b43e-08b4b113a84a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:18.892872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71fbc52-1149-4e32-b43e-08b4b113a84a None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:18.894482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 32/62] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:18.899881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627971b-f928-422c-9cf7-eb9f84de214b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:18.900772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627971b-f928-422c-9cf7-eb9f84de214b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:18.901334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627971b-f928-422c-9cf7-eb9f84de214b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:18.925665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c627971b-f928-422c-9cf7-eb9f84de214b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:18.926862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c627971b-f928-422c-9cf7-eb9f84de214b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:19.021785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 31/63] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:19.316378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925d7b-6240-4d95-a978-3168962e99c5 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:19.317043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925d7b-6240-4d95-a978-3168962e99c5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:19.317537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e925d7b-6240-4d95-a978-3168962e99c5 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:19.319114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 33/64] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:19.325145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcf2db-dd19-4355-aad3-e69458dab5b7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:19.325440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcf2db-dd19-4355-aad3-e69458dab5b7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:19.325720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dcf2db-dd19-4355-aad3-e69458dab5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:19.352500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b6dcf2db-dd19-4355-aad3-e69458dab5b7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:19.353680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b6dcf2db-dd19-4355-aad3-e69458dab5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:19.445984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 32/65] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:19.448225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925d7b-6240-4d95-a978-3168962e99c5 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:19.480591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:19.507140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bd703-1dbd-409e-9913-e8c6e5af9d0e None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:19.507433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bd703-1dbd-409e-9913-e8c6e5af9d0e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:19.507747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7bd703-1dbd-409e-9913-e8c6e5af9d0e None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:19.509118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 33/66] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:19.524123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e3872-ec8d-4ca4-9b4c-a108a0400a46 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:19.526757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e3872-ec8d-4ca4-9b4c-a108a0400a46 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:19.527394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e3872-ec8d-4ca4-9b4c-a108a0400a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:19.567090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f83e3872-ec8d-4ca4-9b4c-a108a0400a46 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:19.569226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f83e3872-ec8d-4ca4-9b4c-a108a0400a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:19.611781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e925d7b-6240-4d95-a978-3168962e99c5 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:19.622574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:19.676078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d4032-6587-41f0-8a31-3866e347851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:19.676720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4032-6587-41f0-8a31-3866e347851e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:19.676997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4032-6587-41f0-8a31-3866e347851e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:19.677270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3d4032-6587-41f0-8a31-3866e347851e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:19.699473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3d4032-6587-41f0-8a31-3866e347851e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-1f3d4032-6587-41f0-8a31-3866e347851e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:19.705009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:19.705940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:19.707084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 34/67] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:19.712197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d4032-6587-41f0-8a31-3866e347851e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:19.733548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 34/68] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:19.745766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e3872-ec8d-4ca4-9b4c-a108a0400a46 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:19.852901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:19.895353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3d4032-6587-41f0-8a31-3866e347851e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:19.914573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e3872-ec8d-4ca4-9b4c-a108a0400a46 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:19.938165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d44e21-49b7-4639-9568-52419f156817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:19.938901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d44e21-49b7-4639-9568-52419f156817 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:19.939189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d44e21-49b7-4639-9568-52419f156817 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:19.939592 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d44e21-49b7-4639-9568-52419f156817 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:19.940273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d44e21-49b7-4639-9568-52419f156817 None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:19.940580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d44e21-49b7-4639-9568-52419f156817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:19.942653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d44e21-49b7-4639-9568-52419f156817 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:19.952986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3b5fc-5188-467d-b306-fa4510acaebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:19.953707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3b5fc-5188-467d-b306-fa4510acaebb None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:19.954064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3b5fc-5188-467d-b306-fa4510acaebb None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:19.954413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3b5fc-5188-467d-b306-fa4510acaebb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:19.955670 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 35/69] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:19.956925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8256da-a8ac-4a32-937b-57aa20efe1e1 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:19.957209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8256da-a8ac-4a32-937b-57aa20efe1e1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:19.957484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8256da-a8ac-4a32-937b-57aa20efe1e1 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:19.958717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 36/70] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:19.959418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8256da-a8ac-4a32-937b-57aa20efe1e1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:19.976171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3b5fc-5188-467d-b306-fa4510acaebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-82a3b5fc-5188-467d-b306-fa4510acaebb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:19.981612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:19.982460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:19.983225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 35/71] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:19.988596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42a6ee-c716-455c-b789-63faa1b36638 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:19.988880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42a6ee-c716-455c-b789-63faa1b36638 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:19.989153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42a6ee-c716-455c-b789-63faa1b36638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.008167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-eb42a6ee-c716-455c-b789-63faa1b36638 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:20.009436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-eb42a6ee-c716-455c-b789-63faa1b36638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:20.018718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.076369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 36/72] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:20.077611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b8c85-5813-4605-993e-c82311ad5667 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.077901 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b8c85-5813-4605-993e-c82311ad5667 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.078177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b8c85-5813-4605-993e-c82311ad5667 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.079419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 37/73] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:20.083602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b8c85-5813-4605-993e-c82311ad5667 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.086851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8256da-a8ac-4a32-937b-57aa20efe1e1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.124028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cd99f-260c-411a-a786-0416beaf1985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.124586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd99f-260c-411a-a786-0416beaf1985 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.124871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd99f-260c-411a-a786-0416beaf1985 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.125143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38cd99f-260c-411a-a786-0416beaf1985 None admin] PATH_INFO: `/v3/users/60efaef5a97045e9b275fbdb11feb3ff` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.129798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.143211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cd99f-260c-411a-a786-0416beaf1985 None admin] RBAC: Authorizing `identity:get_user(user_id=60efaef5a97045e9b275fbdb11feb3ff)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:20.144710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38cd99f-260c-411a-a786-0416beaf1985 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:20.146341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 37/74] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:19 2022] GET /identity/v3/users/60efaef5a97045e9b275fbdb11feb3ff => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:20.147103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cd99f-260c-411a-a786-0416beaf1985 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.200911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b8c85-5813-4605-993e-c82311ad5667 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.244448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12636b7b-6c8e-4085-b22c-ae5965031c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.244970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38cd99f-260c-411a-a786-0416beaf1985 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.245076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636b7b-6c8e-4085-b22c-ae5965031c14 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.245324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636b7b-6c8e-4085-b22c-ae5965031c14 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.245634 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636b7b-6c8e-4085-b22c-ae5965031c14 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.246356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12636b7b-6c8e-4085-b22c-ae5965031c14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:20.246599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12636b7b-6c8e-4085-b22c-ae5965031c14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:20.248012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12636b7b-6c8e-4085-b22c-ae5965031c14 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:20.256209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 38/75] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:20.257160 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0953b-1e63-4ffc-bfe8-b40b5e737af4 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.257444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0953b-1e63-4ffc-bfe8-b40b5e737af4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.257715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0953b-1e63-4ffc-bfe8-b40b5e737af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.270832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.276196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-72b0953b-1e63-4ffc-bfe8-b40b5e737af4 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:20.278041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-72b0953b-1e63-4ffc-bfe8-b40b5e737af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:20.285550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a93d-3bdb-4409-9164-b904d750d88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.293549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a93d-3bdb-4409-9164-b904d750d88f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.293549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a93d-3bdb-4409-9164-b904d750d88f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.293549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8074a93d-3bdb-4409-9164-b904d750d88f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.297436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8074a93d-3bdb-4409-9164-b904d750d88f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-8074a93d-3bdb-4409-9164-b904d750d88f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:20.302220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:20.303231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 38/76] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:20.304280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a93d-3bdb-4409-9164-b904d750d88f None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.357033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 39/77] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:20.357033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0953b-1e63-4ffc-bfe8-b40b5e737af4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.371999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.410318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8074a93d-3bdb-4409-9164-b904d750d88f None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.446188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edcae7-3903-4d73-ab4e-7727af0c222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.446802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edcae7-3903-4d73-ab4e-7727af0c222d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.447089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edcae7-3903-4d73-ab4e-7727af0c222d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.447370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95edcae7-3903-4d73-ab4e-7727af0c222d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.462486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0953b-1e63-4ffc-bfe8-b40b5e737af4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.498726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402ca1b-74ac-4d79-9a0d-7a1b0914a945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.499358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402ca1b-74ac-4d79-9a0d-7a1b0914a945 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.499688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402ca1b-74ac-4d79-9a0d-7a1b0914a945 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.500098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b402ca1b-74ac-4d79-9a0d-7a1b0914a945 None admin] PATH_INFO: `/v3/users/6544ace43e54452fa059337ba0542217` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.501081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402ca1b-74ac-4d79-9a0d-7a1b0914a945 None admin] RBAC: Authorizing `identity:get_user(user_id=6544ace43e54452fa059337ba0542217)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:20.502521 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b402ca1b-74ac-4d79-9a0d-7a1b0914a945 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:20.504173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 40/78] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/users/6544ace43e54452fa059337ba0542217 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:20.504878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402ca1b-74ac-4d79-9a0d-7a1b0914a945 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.509093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.524218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edcae7-3903-4d73-ab4e-7727af0c222d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:20.525665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95edcae7-3903-4d73-ab4e-7727af0c222d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:20.581053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.616993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b402ca1b-74ac-4d79-9a0d-7a1b0914a945 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.632183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 39/79] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:20.633030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edcae7-3903-4d73-ab4e-7727af0c222d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.653076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a81682-a8e4-4b52-ad87-59744843139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.653684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81682-a8e4-4b52-ad87-59744843139c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.653969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81682-a8e4-4b52-ad87-59744843139c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.654245 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a81682-a8e4-4b52-ad87-59744843139c None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.654916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a81682-a8e4-4b52-ad87-59744843139c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:20.655349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a81682-a8e4-4b52-ad87-59744843139c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:20.656687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a81682-a8e4-4b52-ad87-59744843139c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:20.669353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 41/80] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:20.669353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a81682-a8e4-4b52-ad87-59744843139c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.727397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.739150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95edcae7-3903-4d73-ab4e-7727af0c222d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.760909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a81682-a8e4-4b52-ad87-59744843139c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.772526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdfb6c-1eed-461b-9950-411790248eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.773162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdfb6c-1eed-461b-9950-411790248eb4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.773445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdfb6c-1eed-461b-9950-411790248eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.773721 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdfb6c-1eed-461b-9950-411790248eb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.784152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdfb6c-1eed-461b-9950-411790248eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-c3bdfb6c-1eed-461b-9950-411790248eb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:20.789157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:20.790024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:20.790776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 40/81] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:20.791387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdfb6c-1eed-461b-9950-411790248eb4 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.794835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781d83-68ed-4f51-8066-daded5d2374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.795715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781d83-68ed-4f51-8066-daded5d2374e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.796003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781d83-68ed-4f51-8066-daded5d2374e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.796275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781d83-68ed-4f51-8066-daded5d2374e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.807606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.861476 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06781d83-68ed-4f51-8066-daded5d2374e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:20.862918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06781d83-68ed-4f51-8066-daded5d2374e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:20.889503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdfb6c-1eed-461b-9950-411790248eb4 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:20.921782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239176b0-2392-4502-b0db-3df7a376d58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:20.922345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239176b0-2392-4502-b0db-3df7a376d58a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:20.922619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239176b0-2392-4502-b0db-3df7a376d58a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:20.922897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239176b0-2392-4502-b0db-3df7a376d58a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:20.924052 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239176b0-2392-4502-b0db-3df7a376d58a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:20.924176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:20.925491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239176b0-2392-4502-b0db-3df7a376d58a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:20.927061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 41/82] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:20.927849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239176b0-2392-4502-b0db-3df7a376d58a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:20.964109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 42/83] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:20.967444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781d83-68ed-4f51-8066-daded5d2374e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.006853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.025260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239176b0-2392-4502-b0db-3df7a376d58a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.058784 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b3a79-31f5-456a-a32d-06b1948f7ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.059415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3a79-31f5-456a-a32d-06b1948f7ada None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.059730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3a79-31f5-456a-a32d-06b1948f7ada None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.060015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b3a79-31f5-456a-a32d-06b1948f7ada None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.061164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b3a79-31f5-456a-a32d-06b1948f7ada None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.062605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6b3a79-31f5-456a-a32d-06b1948f7ada None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.062879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06781d83-68ed-4f51-8066-daded5d2374e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.064308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 42/84] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:21.065084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b3a79-31f5-456a-a32d-06b1948f7ada None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.096698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7e084-78d5-4f7d-bca9-aa1c559356b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.097261 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7e084-78d5-4f7d-bca9-aa1c559356b6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.097543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7e084-78d5-4f7d-bca9-aa1c559356b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.097817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7e084-78d5-4f7d-bca9-aa1c559356b6 None admin] PATH_INFO: `/v3/users/60efaef5a97045e9b275fbdb11feb3ff` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.098959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7e084-78d5-4f7d-bca9-aa1c559356b6 None admin] RBAC: Authorizing `identity:get_user(user_id=60efaef5a97045e9b275fbdb11feb3ff)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.100424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7e084-78d5-4f7d-bca9-aa1c559356b6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.101978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 43/85] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:20 2022] GET /identity/v3/users/60efaef5a97045e9b275fbdb11feb3ff => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:21.102713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7e084-78d5-4f7d-bca9-aa1c559356b6 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.135277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.163523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b3a79-31f5-456a-a32d-06b1948f7ada None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.197351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0bde2-03c4-4313-a735-77138c4846a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.197963 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0bde2-03c4-4313-a735-77138c4846a1 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.198233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0bde2-03c4-4313-a735-77138c4846a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.198510 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c0bde2-03c4-4313-a735-77138c4846a1 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.199175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0bde2-03c4-4313-a735-77138c4846a1 None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:21.199483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0bde2-03c4-4313-a735-77138c4846a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.200048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7e084-78d5-4f7d-bca9-aa1c559356b6 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.200869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c0bde2-03c4-4313-a735-77138c4846a1 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.208770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 43/86] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:21.209403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0bde2-03c4-4313-a735-77138c4846a1 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.223126 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.234107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19052f-e3cb-49c2-af50-9e8ada8c5ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.234712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19052f-e3cb-49c2-af50-9e8ada8c5ab3 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.234996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19052f-e3cb-49c2-af50-9e8ada8c5ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.235272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b19052f-e3cb-49c2-af50-9e8ada8c5ab3 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.242566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19052f-e3cb-49c2-af50-9e8ada8c5ab3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.242566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b19052f-e3cb-49c2-af50-9e8ada8c5ab3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.306810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c0bde2-03c4-4313-a735-77138c4846a1 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.323013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 44/87] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:21 2022] POST /identity/v3/users => generated 289 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:21.323868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19052f-e3cb-49c2-af50-9e8ada8c5ab3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.344647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd2f1f-9dd2-4088-9132-302b71260e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.345190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd2f1f-9dd2-4088-9132-302b71260e29 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.345471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd2f1f-9dd2-4088-9132-302b71260e29 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.345748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd2f1f-9dd2-4088-9132-302b71260e29 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.346977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd2f1f-9dd2-4088-9132-302b71260e29 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.351334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd2f1f-9dd2-4088-9132-302b71260e29 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.351334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 44/88] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:21.351334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd2f1f-9dd2-4088-9132-302b71260e29 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.433870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.444827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b19052f-e3cb-49c2-af50-9e8ada8c5ab3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.453176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.475652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd2f1f-9dd2-4088-9132-302b71260e29 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.483543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958df4-e0d6-4bad-a232-6be0a4110caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.484179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958df4-e0d6-4bad-a232-6be0a4110caa None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.484464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958df4-e0d6-4bad-a232-6be0a4110caa None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.484739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65958df4-e0d6-4bad-a232-6be0a4110caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.485488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65958df4-e0d6-4bad-a232-6be0a4110caa None admin] RBAC: Adding query filter params (role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=f523dae04dcf427480a7d92c16eb5781, user.id=60efaef5a97045e9b275fbdb11feb3ff) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:21.485802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65958df4-e0d6-4bad-a232-6be0a4110caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.487300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65958df4-e0d6-4bad-a232-6be0a4110caa None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.499268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 45/89] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/role_assignments?user.id=60efaef5a97045e9b275fbdb11feb3ff&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:21.499268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958df4-e0d6-4bad-a232-6be0a4110caa None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.529468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa0c2-5dec-49ac-8d01-4f8070d94c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.530104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa0c2-5dec-49ac-8d01-4f8070d94c94 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.530383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa0c2-5dec-49ac-8d01-4f8070d94c94 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.530655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aaaa0c2-5dec-49ac-8d01-4f8070d94c94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.640684 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa0c2-5dec-49ac-8d01-4f8070d94c94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.641524 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65958df4-e0d6-4bad-a232-6be0a4110caa None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.642248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aaaa0c2-5dec-49ac-8d01-4f8070d94c94 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.688128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a25d7-5535-4635-a32b-3aa4175c58d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.688831 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a25d7-5535-4635-a32b-3aa4175c58d3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.689119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a25d7-5535-4635-a32b-3aa4175c58d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.689399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a25d7-5535-4635-a32b-3aa4175c58d3 None admin] PATH_INFO: `/v3/users/60efaef5a97045e9b275fbdb11feb3ff` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.691445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a25d7-5535-4635-a32b-3aa4175c58d3 None admin] RBAC: Authorizing `identity:get_user(user_id=60efaef5a97045e9b275fbdb11feb3ff)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.692944 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9a25d7-5535-4635-a32b-3aa4175c58d3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.694573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 46/90] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/users/60efaef5a97045e9b275fbdb11feb3ff => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:21.695358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a25d7-5535-4635-a32b-3aa4175c58d3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.730476 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.759574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:21.785185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 45/91] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:21.786062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa0c2-5dec-49ac-8d01-4f8070d94c94 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:21.829032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a25d7-5535-4635-a32b-3aa4175c58d3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:21.893764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeac5b-f67a-4b78-bcca-84a420924e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:21.894381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeac5b-f67a-4b78-bcca-84a420924e62 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:21.894681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeac5b-f67a-4b78-bcca-84a420924e62 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:21.894984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbeac5b-f67a-4b78-bcca-84a420924e62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:21.895789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeac5b-f67a-4b78-bcca-84a420924e62 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=f523dae04dcf427480a7d92c16eb5781, user.id=6544ace43e54452fa059337ba0542217) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:21.896108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeac5b-f67a-4b78-bcca-84a420924e62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:21.898982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbeac5b-f67a-4b78-bcca-84a420924e62 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:21.912414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 47/92] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/role_assignments?user.id=6544ace43e54452fa059337ba0542217&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:21.921708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeac5b-f67a-4b78-bcca-84a420924e62 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:22.013707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aaaa0c2-5dec-49ac-8d01-4f8070d94c94 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:22.025952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:22.044010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbeac5b-f67a-4b78-bcca-84a420924e62 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:22.081874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec390f6-3df7-4daf-94f8-ca80ac5e1f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:22.082511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec390f6-3df7-4daf-94f8-ca80ac5e1f5e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:22.082890 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec390f6-3df7-4daf-94f8-ca80ac5e1f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:22.083176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec390f6-3df7-4daf-94f8-ca80ac5e1f5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:22.086189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01fe54-e9a4-49a7-acc1-d8ffde8798b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:22.086953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01fe54-e9a4-49a7-acc1-d8ffde8798b7 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:22.087247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01fe54-e9a4-49a7-acc1-d8ffde8798b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:22.087546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01fe54-e9a4-49a7-acc1-d8ffde8798b7 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:22.088700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01fe54-e9a4-49a7-acc1-d8ffde8798b7 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:22.090228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01fe54-e9a4-49a7-acc1-d8ffde8798b7 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:22.091930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 48/93] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:22.098189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01fe54-e9a4-49a7-acc1-d8ffde8798b7 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:22.184136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:22.224258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec390f6-3df7-4daf-94f8-ca80ac5e1f5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:22.225756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec390f6-3df7-4daf-94f8-ca80ac5e1f5e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:22.295194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01fe54-e9a4-49a7-acc1-d8ffde8798b7 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:22.361047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eab4e-8833-4959-b69d-f3a5a42ea1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:22.361666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eab4e-8833-4959-b69d-f3a5a42ea1ca None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:22.361951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eab4e-8833-4959-b69d-f3a5a42ea1ca None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:22.362227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446eab4e-8833-4959-b69d-f3a5a42ea1ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:22.362974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eab4e-8833-4959-b69d-f3a5a42ea1ca None admin] RBAC: Adding query filter params (role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=f523dae04dcf427480a7d92c16eb5781, user.id=60efaef5a97045e9b275fbdb11feb3ff) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:22.363286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eab4e-8833-4959-b69d-f3a5a42ea1ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:22.364783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446eab4e-8833-4959-b69d-f3a5a42ea1ca None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:22.377125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 49/94] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:22 2022] GET /identity/v3/role_assignments?user.id=60efaef5a97045e9b275fbdb11feb3ff&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 259 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:22.401421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 46/95] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:22.408092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eab4e-8833-4959-b69d-f3a5a42ea1ca None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:22.430757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:22.534408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446eab4e-8833-4959-b69d-f3a5a42ea1ca None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:22.582745 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86b691-bc57-436f-93a2-ade62156e465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:22.583321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b691-bc57-436f-93a2-ade62156e465 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:22.583636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b691-bc57-436f-93a2-ade62156e465 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:22.583920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86b691-bc57-436f-93a2-ade62156e465 None admin] PATH_INFO: `/v3/projects/ad1e9f8886a742ed8e4dae0e08252eba` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:22.585090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86b691-bc57-436f-93a2-ade62156e465 None admin] RBAC: Authorizing `identity:get_project(project_id=ad1e9f8886a742ed8e4dae0e08252eba)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:22.586537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86b691-bc57-436f-93a2-ade62156e465 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:22.588671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 50/96] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:22 2022] GET /identity/v3/projects/ad1e9f8886a742ed8e4dae0e08252eba => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:22.594977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec390f6-3df7-4daf-94f8-ca80ac5e1f5e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:22.705217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:22.728482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec390f6-3df7-4daf-94f8-ca80ac5e1f5e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:22.775344 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaacaf53-9052-4aed-b7ed-66ec4896cf6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:22.776045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacaf53-9052-4aed-b7ed-66ec4896cf6a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:22.776336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacaf53-9052-4aed-b7ed-66ec4896cf6a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:22.777304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaacaf53-9052-4aed-b7ed-66ec4896cf6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:22.778057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacaf53-9052-4aed-b7ed-66ec4896cf6a None admin] RBAC: Adding query filter params (role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=ad1e9f8886a742ed8e4dae0e08252eba, user.id=60efaef5a97045e9b275fbdb11feb3ff) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:22.778373 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacaf53-9052-4aed-b7ed-66ec4896cf6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:22.779830 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaacaf53-9052-4aed-b7ed-66ec4896cf6a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:22.793496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 47/97] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:22 2022] GET /identity/v3/role_assignments?user.id=60efaef5a97045e9b275fbdb11feb3ff&scope.project.id=ad1e9f8886a742ed8e4dae0e08252eba&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:24.095091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1b1ca-d4c5-4afd-8f08-53e8754ebf19 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:24.096121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1b1ca-d4c5-4afd-8f08-53e8754ebf19 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:24.096612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed1b1ca-d4c5-4afd-8f08-53e8754ebf19 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:24.098192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 51/98] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:24.103976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a7c74-fe22-4d7f-97bd-c7db3943573a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:24.104832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a7c74-fe22-4d7f-97bd-c7db3943573a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:24.105315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a7c74-fe22-4d7f-97bd-c7db3943573a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:24.128847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-0f4a7c74-fe22-4d7f-97bd-c7db3943573a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:24.130419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0f4a7c74-fe22-4d7f-97bd-c7db3943573a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:24.221705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 48/99] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:24.573037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d7d96-67d4-484d-a66e-d74c1970ba7b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:24.573436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d7d96-67d4-484d-a66e-d74c1970ba7b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:24.573654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95d7d96-67d4-484d-a66e-d74c1970ba7b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:24.574998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 52/100] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:24.580283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02ccc-b19e-462f-99d9-157a93c8453e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:24.580574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02ccc-b19e-462f-99d9-157a93c8453e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:24.580860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b02ccc-b19e-462f-99d9-157a93c8453e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:24.607874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-89b02ccc-b19e-462f-99d9-157a93c8453e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:24.609068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-89b02ccc-b19e-462f-99d9-157a93c8453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:24.709254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 49/101] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:24.754720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d7d96-67d4-484d-a66e-d74c1970ba7b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:24.860844 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b3c8f-35cb-4b06-bc2b-ee8d91b2a573 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:24.861033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b3c8f-35cb-4b06-bc2b-ee8d91b2a573 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:24.861324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7b3c8f-35cb-4b06-bc2b-ee8d91b2a573 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:24.862820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 50/102] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:24.869778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8b16-e595-4e57-91c3-06f57442522d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:24.870350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8b16-e595-4e57-91c3-06f57442522d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:24.870883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbca8b16-e595-4e57-91c3-06f57442522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:24.878247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:24.879705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:24.892851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-cbca8b16-e595-4e57-91c3-06f57442522d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:24.894958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cbca8b16-e595-4e57-91c3-06f57442522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:24.904165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95d7d96-67d4-484d-a66e-d74c1970ba7b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:24.969709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf81c6-120b-457e-b2b7-266cd879e184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:24.970691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf81c6-120b-457e-b2b7-266cd879e184 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:24.971188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf81c6-120b-457e-b2b7-266cd879e184 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:24.971672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf81c6-120b-457e-b2b7-266cd879e184 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:24.990226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf81c6-120b-457e-b2b7-266cd879e184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-59bf81c6-120b-457e-b2b7-266cd879e184 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:24.995445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:24.996291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:24.997031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:25.002702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 53/103] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:25.012105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf81c6-120b-457e-b2b7-266cd879e184 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:25.028216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 51/104] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:25.158454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf81c6-120b-457e-b2b7-266cd879e184 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:25.206317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b82c0-8556-4fc5-8d4d-f7ad6b36aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:25.207354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b82c0-8556-4fc5-8d4d-f7ad6b36aea9 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:25.207871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b82c0-8556-4fc5-8d4d-f7ad6b36aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:25.208335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b82c0-8556-4fc5-8d4d-f7ad6b36aea9 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:25.209194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b82c0-8556-4fc5-8d4d-f7ad6b36aea9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:25.209689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b82c0-8556-4fc5-8d4d-f7ad6b36aea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:25.211271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720b82c0-8556-4fc5-8d4d-f7ad6b36aea9 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:25.221955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 54/105] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:25.228107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8b16-e595-4e57-91c3-06f57442522d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:25.314215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b82c0-8556-4fc5-8d4d-f7ad6b36aea9 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:25.332502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:25.362578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbca8b16-e595-4e57-91c3-06f57442522d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:25.438968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17484623-50a2-485e-b403-f7b961bdc0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:25.439664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17484623-50a2-485e-b403-f7b961bdc0a7 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:25.439952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17484623-50a2-485e-b403-f7b961bdc0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:25.440234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17484623-50a2-485e-b403-f7b961bdc0a7 None admin] PATH_INFO: `/v3/users/41c56d0aaa05495db0e1f9d5223f4923` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:25.442892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:25.464307 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720b82c0-8556-4fc5-8d4d-f7ad6b36aea9 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:25.470202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17484623-50a2-485e-b403-f7b961bdc0a7 None admin] RBAC: Authorizing `identity:get_user(user_id=41c56d0aaa05495db0e1f9d5223f4923)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:25.471709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17484623-50a2-485e-b403-f7b961bdc0a7 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:25.473426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 52/106] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:25 2022] GET /identity/v3/users/41c56d0aaa05495db0e1f9d5223f4923 => generated 289 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:25.474611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a443c7f-021c-4993-acdc-a68885d0d60f None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:25.474897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a443c7f-021c-4993-acdc-a68885d0d60f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:25.475178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a443c7f-021c-4993-acdc-a68885d0d60f None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:25.476749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 53/107] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:25.484842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a443c7f-021c-4993-acdc-a68885d0d60f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:25.514477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502b92a-bdb1-4d55-8427-8e8a79618254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:25.515294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502b92a-bdb1-4d55-8427-8e8a79618254 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:25.515674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502b92a-bdb1-4d55-8427-8e8a79618254 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:25.516018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502b92a-bdb1-4d55-8427-8e8a79618254 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:25.530796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502b92a-bdb1-4d55-8427-8e8a79618254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-2502b92a-bdb1-4d55-8427-8e8a79618254 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:25.536114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:25.536993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:25.537808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 55/108] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:25.538453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502b92a-bdb1-4d55-8427-8e8a79618254 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:25.609371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:25.612989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a443c7f-021c-4993-acdc-a68885d0d60f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:25.643862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502b92a-bdb1-4d55-8427-8e8a79618254 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:25.650545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab92452-47f1-4b71-a99f-6689710060b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:25.651204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab92452-47f1-4b71-a99f-6689710060b7 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:25.651488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab92452-47f1-4b71-a99f-6689710060b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:25.651917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab92452-47f1-4b71-a99f-6689710060b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:25.679221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4cf2a-de2e-494f-832a-d501fd41b9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:25.680060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4cf2a-de2e-494f-832a-d501fd41b9f8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:25.680345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4cf2a-de2e-494f-832a-d501fd41b9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:25.680623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4cf2a-de2e-494f-832a-d501fd41b9f8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:25.681755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4cf2a-de2e-494f-832a-d501fd41b9f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:25.683878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4cf2a-de2e-494f-832a-d501fd41b9f8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:25.685434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 56/109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:25.686531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d0c8-e9ca-41a7-a224-3bfb08bdd4a2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:25.686857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d0c8-e9ca-41a7-a224-3bfb08bdd4a2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:25.687137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5410d0c8-e9ca-41a7-a224-3bfb08bdd4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:25.704699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-5410d0c8-e9ca-41a7-a224-3bfb08bdd4a2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:25.705804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-5410d0c8-e9ca-41a7-a224-3bfb08bdd4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:25.722031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:25.733469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab92452-47f1-4b71-a99f-6689710060b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:25.735484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab92452-47f1-4b71-a99f-6689710060b7 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:25.775049 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 57/110] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:25.775745 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d0c8-e9ca-41a7-a224-3bfb08bdd4a2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:25.857666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 54/111] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:25.860274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eaad4-32cd-4e42-a2db-a236798725da None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:25.860769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eaad4-32cd-4e42-a2db-a236798725da None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:25.861268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076eaad4-32cd-4e42-a2db-a236798725da None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:25.862456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:25.864288 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 55/112] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:25.865257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eaad4-32cd-4e42-a2db-a236798725da None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:25.913042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5410d0c8-e9ca-41a7-a224-3bfb08bdd4a2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:25.962080 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc39a7-cdfe-4535-92c1-7de7c1a5cca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:25.963118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc39a7-cdfe-4535-92c1-7de7c1a5cca9 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:25.963454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc39a7-cdfe-4535-92c1-7de7c1a5cca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:25.963850 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fc39a7-cdfe-4535-92c1-7de7c1a5cca9 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:25.964959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc39a7-cdfe-4535-92c1-7de7c1a5cca9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:25.965409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc39a7-cdfe-4535-92c1-7de7c1a5cca9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:25.967152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fc39a7-cdfe-4535-92c1-7de7c1a5cca9 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:25.978503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 58/113] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:25.980689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:25.980820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc39a7-cdfe-4535-92c1-7de7c1a5cca9 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:25.996282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076eaad4-32cd-4e42-a2db-a236798725da None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:26.038975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678246ec-77bb-4902-b99c-d2ab370981d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:26.040167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678246ec-77bb-4902-b99c-d2ab370981d9 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.040453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678246ec-77bb-4902-b99c-d2ab370981d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.040728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678246ec-77bb-4902-b99c-d2ab370981d9 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.041699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678246ec-77bb-4902-b99c-d2ab370981d9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:26.043863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678246ec-77bb-4902-b99c-d2ab370981d9 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:26.092774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fc39a7-cdfe-4535-92c1-7de7c1a5cca9 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:26.119364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:26.126853 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0753e98d-8a79-4ca1-8f7e-fd22e7420187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:26.127485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e98d-8a79-4ca1-8f7e-fd22e7420187 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.127795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e98d-8a79-4ca1-8f7e-fd22e7420187 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.128069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0753e98d-8a79-4ca1-8f7e-fd22e7420187 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.129186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753e98d-8a79-4ca1-8f7e-fd22e7420187 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:26.130644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0753e98d-8a79-4ca1-8f7e-fd22e7420187 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:26.132456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 59/114] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:25 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:26.135798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 56/115] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:32:25 2022] POST /identity/v3/projects => generated 302 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:26.135798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678246ec-77bb-4902-b99c-d2ab370981d9 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:26.138310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb310fa-6fef-4a71-be22-5d380fc586f4 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.138596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb310fa-6fef-4a71-be22-5d380fc586f4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.138872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb310fa-6fef-4a71-be22-5d380fc586f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.159374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-4fb310fa-6fef-4a71-be22-5d380fc586f4 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:26.160777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4fb310fa-6fef-4a71-be22-5d380fc586f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:26.242912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 60/116] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:26.243790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb310fa-6fef-4a71-be22-5d380fc586f4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:26.302839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678246ec-77bb-4902-b99c-d2ab370981d9 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:26.345936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e01d8-28f7-4a2f-9016-527b9545b477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:26.346573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e01d8-28f7-4a2f-9016-527b9545b477 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.346862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e01d8-28f7-4a2f-9016-527b9545b477 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.347133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e01d8-28f7-4a2f-9016-527b9545b477 None admin] PATH_INFO: `/v3/users/60efaef5a97045e9b275fbdb11feb3ff` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.348307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e01d8-28f7-4a2f-9016-527b9545b477 None admin] RBAC: Authorizing `identity:get_user(user_id=60efaef5a97045e9b275fbdb11feb3ff)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:26.350645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e01d8-28f7-4a2f-9016-527b9545b477 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:26.356314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 57/117] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:26 2022] GET /identity/v3/users/60efaef5a97045e9b275fbdb11feb3ff => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:26.356314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e01d8-28f7-4a2f-9016-527b9545b477 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:26.369098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:26.386865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb310fa-6fef-4a71-be22-5d380fc586f4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:26.418180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:26.429149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba5b931-52f3-42a3-a247-a03f90a5d2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:26.430270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b931-52f3-42a3-a247-a03f90a5d2b0 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.430619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b931-52f3-42a3-a247-a03f90a5d2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.431434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba5b931-52f3-42a3-a247-a03f90a5d2b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.445927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba5b931-52f3-42a3-a247-a03f90a5d2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-5ba5b931-52f3-42a3-a247-a03f90a5d2b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:26.452112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:26.452939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:26.453912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 61/118] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:26.456473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba530a4-ab5b-4ca4-ae86-d9ee24eacb49 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.456842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba530a4-ab5b-4ca4-ae86-d9ee24eacb49 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.457186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba530a4-ab5b-4ca4-ae86-d9ee24eacb49 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.458508 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 62/119] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:26.459314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba530a4-ab5b-4ca4-ae86-d9ee24eacb49 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:26.474615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e01d8-28f7-4a2f-9016-527b9545b477 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:26.512345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78f074-daaa-47e9-a929-76979cc1c164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:26.512536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78f074-daaa-47e9-a929-76979cc1c164 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.512809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78f074-daaa-47e9-a929-76979cc1c164 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.513084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec78f074-daaa-47e9-a929-76979cc1c164 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.513874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78f074-daaa-47e9-a929-76979cc1c164 None admin] RBAC: Adding query filter params (role.id=43b28df8274a4b678cfbbb3d8eac0f52, scope.project.id=f523dae04dcf427480a7d92c16eb5781, user.id=41c56d0aaa05495db0e1f9d5223f4923) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:26.514188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78f074-daaa-47e9-a929-76979cc1c164 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:26.515718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec78f074-daaa-47e9-a929-76979cc1c164 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:26.521832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 58/120] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:26 2022] GET /identity/v3/role_assignments?user.id=41c56d0aaa05495db0e1f9d5223f4923&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=43b28df8274a4b678cfbbb3d8eac0f52 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:26.522704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78f074-daaa-47e9-a929-76979cc1c164 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:26.616558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:26.618609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba530a4-ab5b-4ca4-ae86-d9ee24eacb49 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:26.644364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec78f074-daaa-47e9-a929-76979cc1c164 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:26.667953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a33288-fb58-4d5b-9de7-246ac1f3b0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:26.669734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a33288-fb58-4d5b-9de7-246ac1f3b0d3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.670403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a33288-fb58-4d5b-9de7-246ac1f3b0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.670968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a33288-fb58-4d5b-9de7-246ac1f3b0d3 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.672750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a33288-fb58-4d5b-9de7-246ac1f3b0d3 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:26.675213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a33288-fb58-4d5b-9de7-246ac1f3b0d3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:26.679720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 63/121] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:26 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:26.683915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaadc1-239c-47d0-a8e7-560c81fe0958 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.683915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaadc1-239c-47d0-a8e7-560c81fe0958 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.683915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcaadc1-239c-47d0-a8e7-560c81fe0958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.693968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133df7d-df05-473c-bdaa-3f8a0453394e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:26.694596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133df7d-df05-473c-bdaa-3f8a0453394e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.694877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133df7d-df05-473c-bdaa-3f8a0453394e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.695153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5133df7d-df05-473c-bdaa-3f8a0453394e None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.695900 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133df7d-df05-473c-bdaa-3f8a0453394e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:26.696208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133df7d-df05-473c-bdaa-3f8a0453394e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:26.697606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5133df7d-df05-473c-bdaa-3f8a0453394e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:26.709183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-3dcaadc1-239c-47d0-a8e7-560c81fe0958 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:26.710390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3dcaadc1-239c-47d0-a8e7-560c81fe0958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:26.712462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 59/122] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:26.713488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133df7d-df05-473c-bdaa-3f8a0453394e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:26.783833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:26.805714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 64/123] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:26.806799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaadc1-239c-47d0-a8e7-560c81fe0958 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:26.898614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5133df7d-df05-473c-bdaa-3f8a0453394e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:26.956529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592cb81-8aa9-4f5a-97a8-b0e4f2637a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:26.957406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592cb81-8aa9-4f5a-97a8-b0e4f2637a75 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:26.957832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592cb81-8aa9-4f5a-97a8-b0e4f2637a75 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:26.958268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b592cb81-8aa9-4f5a-97a8-b0e4f2637a75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:26.966698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:26.971547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b592cb81-8aa9-4f5a-97a8-b0e4f2637a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-b592cb81-8aa9-4f5a-97a8-b0e4f2637a75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:26.977715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:26.978756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:26.979725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:26.982350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 60/124] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:26.983499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592cb81-8aa9-4f5a-97a8-b0e4f2637a75 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.015297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcaadc1-239c-47d0-a8e7-560c81fe0958 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:27.069209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea3ee-257e-45bb-907f-dae07b591543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:27.069810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea3ee-257e-45bb-907f-dae07b591543 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:27.070102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea3ee-257e-45bb-907f-dae07b591543 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:27.070395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ea3ee-257e-45bb-907f-dae07b591543 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781/users/60efaef5a97045e9b275fbdb11feb3ff/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:27.076829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea3ee-257e-45bb-907f-dae07b591543 None admin] RBAC: Authorizing `identity:create_grant(project_id=f523dae04dcf427480a7d92c16eb5781, user_id=60efaef5a97045e9b275fbdb11feb3ff, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:27.078275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ea3ee-257e-45bb-907f-dae07b591543 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:27.098280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b592cb81-8aa9-4f5a-97a8-b0e4f2637a75 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:27.135412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc160405-03e2-4f6d-baa9-c7f9a4709295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:27.136393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc160405-03e2-4f6d-baa9-c7f9a4709295 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:27.136893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc160405-03e2-4f6d-baa9-c7f9a4709295 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:27.137306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc160405-03e2-4f6d-baa9-c7f9a4709295 None admin] PATH_INFO: `/v3/users/6544ace43e54452fa059337ba0542217` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:27.138791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc160405-03e2-4f6d-baa9-c7f9a4709295 None admin] RBAC: Authorizing `identity:get_user(user_id=6544ace43e54452fa059337ba0542217)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:27.140483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc160405-03e2-4f6d-baa9-c7f9a4709295 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:27.142859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 61/125] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:26 2022] GET /identity/v3/users/6544ace43e54452fa059337ba0542217 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:27.144015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc160405-03e2-4f6d-baa9-c7f9a4709295 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.164375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 65/126] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:26 2022] PUT /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781/users/60efaef5a97045e9b275fbdb11feb3ff/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:27.165891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea3ee-257e-45bb-907f-dae07b591543 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.217883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:27.225283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:27.254419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc160405-03e2-4f6d-baa9-c7f9a4709295 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:27.284781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ea3ee-257e-45bb-907f-dae07b591543 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:27.292858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001735d-90bd-4ec0-a79d-b95704c1400d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:27.293707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001735d-90bd-4ec0-a79d-b95704c1400d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:27.294132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001735d-90bd-4ec0-a79d-b95704c1400d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:27.294567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001735d-90bd-4ec0-a79d-b95704c1400d None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:27.295385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001735d-90bd-4ec0-a79d-b95704c1400d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:27.295921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001735d-90bd-4ec0-a79d-b95704c1400d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:27.297501 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001735d-90bd-4ec0-a79d-b95704c1400d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:27.306579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 62/127] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:27.313541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001735d-90bd-4ec0-a79d-b95704c1400d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.324906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840a79d-f6c1-4686-aa27-52b4292b74cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:27.325470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840a79d-f6c1-4686-aa27-52b4292b74cb None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:27.325804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840a79d-f6c1-4686-aa27-52b4292b74cb None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:27.326085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b840a79d-f6c1-4686-aa27-52b4292b74cb None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:27.327297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840a79d-f6c1-4686-aa27-52b4292b74cb None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:27.328881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b840a79d-f6c1-4686-aa27-52b4292b74cb None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:27.330897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 66/128] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:27 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:27.331488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840a79d-f6c1-4686-aa27-52b4292b74cb None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.419189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001735d-90bd-4ec0-a79d-b95704c1400d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:27.449239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:27.451400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b840a79d-f6c1-4686-aa27-52b4292b74cb None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:27.458304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e73fc-7a74-40dd-ba89-2c486b04527a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:27.458952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e73fc-7a74-40dd-ba89-2c486b04527a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:27.459236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e73fc-7a74-40dd-ba89-2c486b04527a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:27.464233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e73fc-7a74-40dd-ba89-2c486b04527a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:27.466641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:27.471337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e73fc-7a74-40dd-ba89-2c486b04527a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-983e73fc-7a74-40dd-ba89-2c486b04527a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:27.476202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:27.477062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 63/129] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:27.478237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e73fc-7a74-40dd-ba89-2c486b04527a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.493819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d56eba-def3-4bac-9e04-2b34f913bc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:27.498427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d56eba-def3-4bac-9e04-2b34f913bc91 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:27.498427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d56eba-def3-4bac-9e04-2b34f913bc91 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:27.498427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d56eba-def3-4bac-9e04-2b34f913bc91 None admin] PATH_INFO: `/v3/users/60efaef5a97045e9b275fbdb11feb3ff` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:27.498427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d56eba-def3-4bac-9e04-2b34f913bc91 None admin] RBAC: Authorizing `identity:get_user(user_id=60efaef5a97045e9b275fbdb11feb3ff)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:27.498427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d56eba-def3-4bac-9e04-2b34f913bc91 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:27.501755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 67/130] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:27 2022] GET /identity/v3/users/60efaef5a97045e9b275fbdb11feb3ff => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:27.502603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d56eba-def3-4bac-9e04-2b34f913bc91 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.586712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e73fc-7a74-40dd-ba89-2c486b04527a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:27.611015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d56eba-def3-4bac-9e04-2b34f913bc91 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:27.621539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb5301-a254-484a-bfc5-ad44077cfc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:27.622213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb5301-a254-484a-bfc5-ad44077cfc7b None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:27.622497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb5301-a254-484a-bfc5-ad44077cfc7b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:27.622778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb5301-a254-484a-bfc5-ad44077cfc7b None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781/users/6544ace43e54452fa059337ba0542217/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:27.624993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb5301-a254-484a-bfc5-ad44077cfc7b None admin] RBAC: Authorizing `identity:create_grant(project_id=f523dae04dcf427480a7d92c16eb5781, user_id=6544ace43e54452fa059337ba0542217, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:27.626453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9eb5301-a254-484a-bfc5-ad44077cfc7b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:27.648608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761fdb6-e497-41f5-a7f5-0f7ecffe6fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:27.649228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761fdb6-e497-41f5-a7f5-0f7ecffe6fdc None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:27.649509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761fdb6-e497-41f5-a7f5-0f7ecffe6fdc None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:27.649784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1761fdb6-e497-41f5-a7f5-0f7ecffe6fdc None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:27.650454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761fdb6-e497-41f5-a7f5-0f7ecffe6fdc None admin] RBAC: Adding query filter params (name=member) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:27.651258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761fdb6-e497-41f5-a7f5-0f7ecffe6fdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:27.652813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1761fdb6-e497-41f5-a7f5-0f7ecffe6fdc None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:27.662023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 68/131] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:27.662779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761fdb6-e497-41f5-a7f5-0f7ecffe6fdc None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.716534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:27.746671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 64/132] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:27 2022] PUT /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781/users/6544ace43e54452fa059337ba0542217/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:27.747307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb5301-a254-484a-bfc5-ad44077cfc7b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.782299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1761fdb6-e497-41f5-a7f5-0f7ecffe6fdc None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:27.819244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cd3b4-30c6-4566-b426-0811d3627766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:27.819930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cd3b4-30c6-4566-b426-0811d3627766 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:27.820216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cd3b4-30c6-4566-b426-0811d3627766 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:27.820489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204cd3b4-30c6-4566-b426-0811d3627766 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:27.821627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cd3b4-30c6-4566-b426-0811d3627766 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:27.823181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204cd3b4-30c6-4566-b426-0811d3627766 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:27.824893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 69/133] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:27 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:27.832594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cd3b4-30c6-4566-b426-0811d3627766 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:27.931341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:28.014628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204cd3b4-30c6-4566-b426-0811d3627766 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:28.027871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:28.062755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9eb5301-a254-484a-bfc5-ad44077cfc7b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:28.080241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17904a9-0461-4df0-94d9-952c45ff5f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:28.080918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17904a9-0461-4df0-94d9-952c45ff5f26 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.081206 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17904a9-0461-4df0-94d9-952c45ff5f26 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.081488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17904a9-0461-4df0-94d9-952c45ff5f26 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781/users/60efaef5a97045e9b275fbdb11feb3ff/roles/8715982a4ad3427498d1a73a6891b4d3` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.085224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17904a9-0461-4df0-94d9-952c45ff5f26 None admin] RBAC: Authorizing `identity:create_grant(project_id=f523dae04dcf427480a7d92c16eb5781, user_id=60efaef5a97045e9b275fbdb11feb3ff, role_id=8715982a4ad3427498d1a73a6891b4d3)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:28.086684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17904a9-0461-4df0-94d9-952c45ff5f26 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:28.120703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461dda9-ac88-4a4b-86d3-0c81baaca91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:28.121472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461dda9-ac88-4a4b-86d3-0c81baaca91b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.121760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461dda9-ac88-4a4b-86d3-0c81baaca91b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.122039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c461dda9-ac88-4a4b-86d3-0c81baaca91b None admin] PATH_INFO: `/v3/users/60efaef5a97045e9b275fbdb11feb3ff` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.123981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461dda9-ac88-4a4b-86d3-0c81baaca91b None admin] RBAC: Authorizing `identity:get_user(user_id=60efaef5a97045e9b275fbdb11feb3ff)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:28.125563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c461dda9-ac88-4a4b-86d3-0c81baaca91b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:28.127354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 65/134] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:27 2022] GET /identity/v3/users/60efaef5a97045e9b275fbdb11feb3ff => generated 275 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:28.132743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461dda9-ac88-4a4b-86d3-0c81baaca91b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:28.165821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 70/135] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:27 2022] PUT /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781/users/60efaef5a97045e9b275fbdb11feb3ff/roles/8715982a4ad3427498d1a73a6891b4d3 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:28.268592 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c461dda9-ac88-4a4b-86d3-0c81baaca91b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:28.290096 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:28.309038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8f4be-c231-4b04-ad1c-a6d173b8429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:28.309775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8f4be-c231-4b04-ad1c-a6d173b8429c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.309953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8f4be-c231-4b04-ad1c-a6d173b8429c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.310230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8f4be-c231-4b04-ad1c-a6d173b8429c None admin] PATH_INFO: `/v3/projects/ad1e9f8886a742ed8e4dae0e08252eba` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.311385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8f4be-c231-4b04-ad1c-a6d173b8429c None admin] RBAC: Authorizing `identity:get_project(project_id=ad1e9f8886a742ed8e4dae0e08252eba)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:28.312866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8f4be-c231-4b04-ad1c-a6d173b8429c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:28.314718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 66/136] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:28 2022] GET /identity/v3/projects/ad1e9f8886a742ed8e4dae0e08252eba => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:28.320635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17904a9-0461-4df0-94d9-952c45ff5f26 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:28.445474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17904a9-0461-4df0-94d9-952c45ff5f26 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:28.482245 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1363d2e5-80db-4fc7-b8c7-b85c787bda62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:28.482925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d2e5-80db-4fc7-b8c7-b85c787bda62 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.483260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d2e5-80db-4fc7-b8c7-b85c787bda62 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.483552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1363d2e5-80db-4fc7-b8c7-b85c787bda62 None admin] PATH_INFO: `/v3/projects/ad1e9f8886a742ed8e4dae0e08252eba/users/60efaef5a97045e9b275fbdb11feb3ff/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.485593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d2e5-80db-4fc7-b8c7-b85c787bda62 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad1e9f8886a742ed8e4dae0e08252eba, user_id=60efaef5a97045e9b275fbdb11feb3ff, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:28.487036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1363d2e5-80db-4fc7-b8c7-b85c787bda62 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:28.599767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 71/137] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:28 2022] PUT /identity/v3/projects/ad1e9f8886a742ed8e4dae0e08252eba/users/60efaef5a97045e9b275fbdb11feb3ff/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:28.715144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9031d8-bbc3-4ca2-97ac-1c3503cb5d97 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.715467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9031d8-bbc3-4ca2-97ac-1c3503cb5d97 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.715742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9031d8-bbc3-4ca2-97ac-1c3503cb5d97 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.717131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 67/138] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:28.722878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625c9e-a32e-40cf-b7a8-e8dda4d61084 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:28.723168 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625c9e-a32e-40cf-b7a8-e8dda4d61084 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:28.723445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7625c9e-a32e-40cf-b7a8-e8dda4d61084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:28.747632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c7625c9e-a32e-40cf-b7a8-e8dda4d61084 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:28.748856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c7625c9e-a32e-40cf-b7a8-e8dda4d61084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:28.780224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:28.837902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 72/139] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:29.372955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9031d8-bbc3-4ca2-97ac-1c3503cb5d97 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.518753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9031d8-bbc3-4ca2-97ac-1c3503cb5d97 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.539669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544d4b4-8504-4c0f-9307-9900eecdb893 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.540183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544d4b4-8504-4c0f-9307-9900eecdb893 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.540290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d544d4b4-8504-4c0f-9307-9900eecdb893 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.541913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 73/140] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:29.556205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7f881-b707-4857-b020-3cf111845895 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.556489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7f881-b707-4857-b020-3cf111845895 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.556800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f7f881-b707-4857-b020-3cf111845895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.583983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-22f7f881-b707-4857-b020-3cf111845895 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:29.585312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-22f7f881-b707-4857-b020-3cf111845895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:29.586100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ce2e7-7f59-4ac6-a2af-3a16d4a24007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.586971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ce2e7-7f59-4ac6-a2af-3a16d4a24007 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.587450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ce2e7-7f59-4ac6-a2af-3a16d4a24007 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.587999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ce2e7-7f59-4ac6-a2af-3a16d4a24007 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.589859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ce2e7-7f59-4ac6-a2af-3a16d4a24007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:29.591482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964ce2e7-7f59-4ac6-a2af-3a16d4a24007 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:29.593298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 68/141] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:29.600446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ce2e7-7f59-4ac6-a2af-3a16d4a24007 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:29.677659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:29.701197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 74/142] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:29.741841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ce2e7-7f59-4ac6-a2af-3a16d4a24007 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:29.790992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f3d31-feae-41f5-9e3a-446efd6fe448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:29.791678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3d31-feae-41f5-9e3a-446efd6fe448 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:29.791973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3d31-feae-41f5-9e3a-446efd6fe448 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:29.792239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9f3d31-feae-41f5-9e3a-446efd6fe448 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:29.792904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f3d31-feae-41f5-9e3a-446efd6fe448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:29.794356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9f3d31-feae-41f5-9e3a-446efd6fe448 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:29.925954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 69/143] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:29 2022] POST /identity/v3/users => generated 283 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:30.150104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7f881-b707-4857-b020-3cf111845895 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.274310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.283846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f7f881-b707-4857-b020-3cf111845895 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.330097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82704021-ff2f-496e-9f4a-b126bedfb60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.330774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704021-ff2f-496e-9f4a-b126bedfb60b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.331052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704021-ff2f-496e-9f4a-b126bedfb60b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.331368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82704021-ff2f-496e-9f4a-b126bedfb60b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.342159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82704021-ff2f-496e-9f4a-b126bedfb60b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-82704021-ff2f-496e-9f4a-b126bedfb60b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:30.346937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:30.347812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:30.348956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 75/144] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:30.354654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f3d31-feae-41f5-9e3a-446efd6fe448 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.474436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9f3d31-feae-41f5-9e3a-446efd6fe448 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.488503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.518455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49779842-114a-4a5d-91f6-3e0213bfc965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.519108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49779842-114a-4a5d-91f6-3e0213bfc965 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.519393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49779842-114a-4a5d-91f6-3e0213bfc965 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.519701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49779842-114a-4a5d-91f6-3e0213bfc965 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.520395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49779842-114a-4a5d-91f6-3e0213bfc965 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:30.520701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49779842-114a-4a5d-91f6-3e0213bfc965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.522102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49779842-114a-4a5d-91f6-3e0213bfc965 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.531742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 70/145] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:30.537787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82704021-ff2f-496e-9f4a-b126bedfb60b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.671594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82704021-ff2f-496e-9f4a-b126bedfb60b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.714877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d882026-2995-4f2e-8e5f-99ab961df9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.715566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882026-2995-4f2e-8e5f-99ab961df9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.715854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882026-2995-4f2e-8e5f-99ab961df9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.716128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d882026-2995-4f2e-8e5f-99ab961df9c5 None admin] PATH_INFO: `/v3/users/41c56d0aaa05495db0e1f9d5223f4923` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.717343 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d882026-2995-4f2e-8e5f-99ab961df9c5 None admin] RBAC: Authorizing `identity:get_user(user_id=41c56d0aaa05495db0e1f9d5223f4923)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.718810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d882026-2995-4f2e-8e5f-99ab961df9c5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.720613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 76/146] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/users/41c56d0aaa05495db0e1f9d5223f4923 => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:30.726364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49779842-114a-4a5d-91f6-3e0213bfc965 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.811426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf978d2-197a-4b92-aba8-d1973521a015 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.813643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf978d2-197a-4b92-aba8-d1973521a015 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.815568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf978d2-197a-4b92-aba8-d1973521a015 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.815568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 77/147] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:30.820818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05999970-844d-4202-8d1a-30181796def2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.821375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05999970-844d-4202-8d1a-30181796def2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.821855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05999970-844d-4202-8d1a-30181796def2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.844272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49779842-114a-4a5d-91f6-3e0213bfc965 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:30.857886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-05999970-844d-4202-8d1a-30181796def2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:30.859219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-05999970-844d-4202-8d1a-30181796def2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:30.878324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.896066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e368326-b3b5-4d74-87dc-81cfaf048a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:30.897057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368326-b3b5-4d74-87dc-81cfaf048a19 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.897611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368326-b3b5-4d74-87dc-81cfaf048a19 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.898029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e368326-b3b5-4d74-87dc-81cfaf048a19 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.899175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e368326-b3b5-4d74-87dc-81cfaf048a19 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:30.900950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e368326-b3b5-4d74-87dc-81cfaf048a19 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:30.903609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 71/148] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:30 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:30.905152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e3d8-e9ed-4f73-8787-730dd57b625d None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.905520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e3d8-e9ed-4f73-8787-730dd57b625d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.905863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0942e3d8-e9ed-4f73-8787-730dd57b625d None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.907331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 72/149] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:30.914170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e3d8-e9ed-4f73-8787-730dd57b625d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:30.965199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 78/150] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:30.966981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b220f-64fa-4f2d-aed2-fdff3f23588e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:30.967453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b220f-64fa-4f2d-aed2-fdff3f23588e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:30.967931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b220f-64fa-4f2d-aed2-fdff3f23588e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:30.976735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:30.992107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-254b220f-64fa-4f2d-aed2-fdff3f23588e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:30.993875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-254b220f-64fa-4f2d-aed2-fdff3f23588e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:31.049193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0942e3d8-e9ed-4f73-8787-730dd57b625d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:31.084395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 79/151] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:31.091709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01283944-ba6b-4ca4-8151-764e85b85f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:31.092668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01283944-ba6b-4ca4-8151-764e85b85f90 None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.093152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01283944-ba6b-4ca4-8151-764e85b85f90 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.093636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01283944-ba6b-4ca4-8151-764e85b85f90 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781/users/41c56d0aaa05495db0e1f9d5223f4923/roles/43b28df8274a4b678cfbbb3d8eac0f52` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.095949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01283944-ba6b-4ca4-8151-764e85b85f90 None admin] RBAC: Authorizing `identity:create_grant(project_id=f523dae04dcf427480a7d92c16eb5781, user_id=41c56d0aaa05495db0e1f9d5223f4923, role_id=43b28df8274a4b678cfbbb3d8eac0f52)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:31.097666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01283944-ba6b-4ca4-8151-764e85b85f90 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:31.174313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 73/152] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:30 2022] PUT /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781/users/41c56d0aaa05495db0e1f9d5223f4923/roles/43b28df8274a4b678cfbbb3d8eac0f52 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:31.458703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b220f-64fa-4f2d-aed2-fdff3f23588e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:31.504056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01283944-ba6b-4ca4-8151-764e85b85f90 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:31.571068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:31.613239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b220f-64fa-4f2d-aed2-fdff3f23588e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:31.634781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01283944-ba6b-4ca4-8151-764e85b85f90 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:31.637188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:31.677928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca8eafe-47fe-4c76-a0e9-9a898b526ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:31.678578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8eafe-47fe-4c76-a0e9-9a898b526ea2 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.679140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8eafe-47fe-4c76-a0e9-9a898b526ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.679402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca8eafe-47fe-4c76-a0e9-9a898b526ea2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.681037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3906fe56-fcc5-400a-8d69-4f92c24e7926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:31.681701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906fe56-fcc5-400a-8d69-4f92c24e7926 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.681975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906fe56-fcc5-400a-8d69-4f92c24e7926 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.682242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3906fe56-fcc5-400a-8d69-4f92c24e7926 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.704412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca8eafe-47fe-4c76-a0e9-9a898b526ea2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:31.706316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3906fe56-fcc5-400a-8d69-4f92c24e7926 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-3906fe56-fcc5-400a-8d69-4f92c24e7926 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:31.711220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:31.712274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:31.713591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-8ca8eafe-47fe-4c76-a0e9-9a898b526ea2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:31.717202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:31.718222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:31.719080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 74/153] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:31.720472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 80/154] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:31.722794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a978-9511-4e84-ade3-9d966c0d6a0d None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.722794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a978-9511-4e84-ade3-9d966c0d6a0d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.722794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5a978-9511-4e84-ade3-9d966c0d6a0d None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.722794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 75/155] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:31.728606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5a978-9511-4e84-ade3-9d966c0d6a0d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:31.729040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936937e-0c4b-4a68-8796-12506b78fc3a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.729314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936937e-0c4b-4a68-8796-12506b78fc3a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.729717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936937e-0c4b-4a68-8796-12506b78fc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.767125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c936937e-0c4b-4a68-8796-12506b78fc3a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:31.768356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c936937e-0c4b-4a68-8796-12506b78fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:31.860815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5a978-9511-4e84-ade3-9d966c0d6a0d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:31.911426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7110e-b119-46fe-8b5e-7512ad16de3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:31.912180 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7110e-b119-46fe-8b5e-7512ad16de3e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:31.912459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7110e-b119-46fe-8b5e-7512ad16de3e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:31.912826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c7110e-b119-46fe-8b5e-7512ad16de3e None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:31.913508 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7110e-b119-46fe-8b5e-7512ad16de3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:31.913812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7110e-b119-46fe-8b5e-7512ad16de3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:31.915451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c7110e-b119-46fe-8b5e-7512ad16de3e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:31.920927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 81/156] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:31.921888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936937e-0c4b-4a68-8796-12506b78fc3a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:31.928559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 76/157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:31.942613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7110e-b119-46fe-8b5e-7512ad16de3e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:31.984097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:32.066392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:32.116599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936937e-0c4b-4a68-8796-12506b78fc3a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:32.143584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c7110e-b119-46fe-8b5e-7512ad16de3e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:32.190161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5069-3fd1-4bea-85fc-940f98783ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:32.190786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5069-3fd1-4bea-85fc-940f98783ca4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:32.191071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5069-3fd1-4bea-85fc-940f98783ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:32.191345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323f5069-3fd1-4bea-85fc-940f98783ca4 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:32.192063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5069-3fd1-4bea-85fc-940f98783ca4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:32.192365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5069-3fd1-4bea-85fc-940f98783ca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:32.193776 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323f5069-3fd1-4bea-85fc-940f98783ca4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:32.207365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 82/158] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:32.211312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da393f6-ac5f-4d7f-a2d3-227dde689477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:32.212286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da393f6-ac5f-4d7f-a2d3-227dde689477 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:32.212808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da393f6-ac5f-4d7f-a2d3-227dde689477 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:32.213275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da393f6-ac5f-4d7f-a2d3-227dde689477 None admin] PATH_INFO: `/v3/users/6544ace43e54452fa059337ba0542217` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:32.213522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5069-3fd1-4bea-85fc-940f98783ca4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:32.219536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da393f6-ac5f-4d7f-a2d3-227dde689477 None admin] RBAC: Authorizing `identity:get_user(user_id=6544ace43e54452fa059337ba0542217)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:32.221302 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da393f6-ac5f-4d7f-a2d3-227dde689477 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:32.223503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 77/159] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:31 2022] GET /identity/v3/users/6544ace43e54452fa059337ba0542217 => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:32.236774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da393f6-ac5f-4d7f-a2d3-227dde689477 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:32.401779 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:32.428747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da393f6-ac5f-4d7f-a2d3-227dde689477 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:32.446399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323f5069-3fd1-4bea-85fc-940f98783ca4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:32.510607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:32.523067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d6b36-2d4a-462f-b1d3-cc4599884b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:32.523710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d6b36-2d4a-462f-b1d3-cc4599884b4c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:32.526416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d6b36-2d4a-462f-b1d3-cc4599884b4c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:32.526416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d6b36-2d4a-462f-b1d3-cc4599884b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:32.528750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3e53a-5ef7-4eba-9ed9-1a32e2d992d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:32.529396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e53a-5ef7-4eba-9ed9-1a32e2d992d0 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:32.529914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e53a-5ef7-4eba-9ed9-1a32e2d992d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:32.530198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3e53a-5ef7-4eba-9ed9-1a32e2d992d0 None admin] PATH_INFO: `/v3/users/60efaef5a97045e9b275fbdb11feb3ff` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:32.532958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3e53a-5ef7-4eba-9ed9-1a32e2d992d0 None admin] RBAC: Authorizing `identity:get_user(user_id=60efaef5a97045e9b275fbdb11feb3ff)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:32.534420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3e53a-5ef7-4eba-9ed9-1a32e2d992d0 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:32.536525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 83/160] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:32 2022] GET /identity/v3/users/60efaef5a97045e9b275fbdb11feb3ff => generated 275 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:32.543447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a9408-870f-4921-bb28-0e21404ea5e3 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:32.543805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a9408-870f-4921-bb28-0e21404ea5e3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:32.544414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a9408-870f-4921-bb28-0e21404ea5e3 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:32.545999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 84/161] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:32.550134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a9408-870f-4921-bb28-0e21404ea5e3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:32.673252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d6b36-2d4a-462f-b1d3-cc4599884b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:32.674704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d6b36-2d4a-462f-b1d3-cc4599884b4c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:32.777955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a9408-870f-4921-bb28-0e21404ea5e3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:32.837040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:32.839314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec8c2-5eb2-4074-ba9e-921f41e0bf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:32.839959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec8c2-5eb2-4074-ba9e-921f41e0bf40 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:32.840236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec8c2-5eb2-4074-ba9e-921f41e0bf40 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:32.840506 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ec8c2-5eb2-4074-ba9e-921f41e0bf40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:32.863852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 78/162] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:32.865144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbd55-e901-48ff-8660-510fcf8adb46 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:32.865431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbd55-e901-48ff-8660-510fcf8adb46 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:32.865707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9cbd55-e901-48ff-8660-510fcf8adb46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:32.897607 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ec9cbd55-e901-48ff-8660-510fcf8adb46 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:32.898842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ec9cbd55-e901-48ff-8660-510fcf8adb46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:32.972296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:32.976583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ec8c2-5eb2-4074-ba9e-921f41e0bf40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:32.978044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ec8c2-5eb2-4074-ba9e-921f41e0bf40 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:33.016682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 79/163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:33.017548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cbd55-e901-48ff-8660-510fcf8adb46 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:33.089727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 85/164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:33.090539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec8c2-5eb2-4074-ba9e-921f41e0bf40 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:33.207391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:33.214339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ec8c2-5eb2-4074-ba9e-921f41e0bf40 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:33.234055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9cbd55-e901-48ff-8660-510fcf8adb46 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:33.257626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0248-15b0-4d36-840e-ef01c2604acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:33.258267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0248-15b0-4d36-840e-ef01c2604acb None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.258551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0248-15b0-4d36-840e-ef01c2604acb None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.258829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e0248-15b0-4d36-840e-ef01c2604acb None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:33.261336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e0248-15b0-4d36-840e-ef01c2604acb None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:33.262777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e0248-15b0-4d36-840e-ef01c2604acb None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:33.264423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 86/165] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:33 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:33.265187 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0248-15b0-4d36-840e-ef01c2604acb None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:33.269378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:33.288830 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69618ecf-e716-43ec-8cad-44cfe9e97e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:33.289904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69618ecf-e716-43ec-8cad-44cfe9e97e66 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.290185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69618ecf-e716-43ec-8cad-44cfe9e97e66 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.290459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69618ecf-e716-43ec-8cad-44cfe9e97e66 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:33.301492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69618ecf-e716-43ec-8cad-44cfe9e97e66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-69618ecf-e716-43ec-8cad-44cfe9e97e66 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:33.307015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:33.307916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:33.309563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 80/166] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:33.310396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69618ecf-e716-43ec-8cad-44cfe9e97e66 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:33.415944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69618ecf-e716-43ec-8cad-44cfe9e97e66 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:33.439023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e0248-15b0-4d36-840e-ef01c2604acb None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:33.452440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cbbbf-b8e9-447b-82df-328e45a02374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:33.453048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cbbbf-b8e9-447b-82df-328e45a02374 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.453326 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cbbbf-b8e9-447b-82df-328e45a02374 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.453595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cbbbf-b8e9-447b-82df-328e45a02374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:33.454325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cbbbf-b8e9-447b-82df-328e45a02374 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=f523dae04dcf427480a7d92c16eb5781, user.id=6544ace43e54452fa059337ba0542217) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:33.454630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cbbbf-b8e9-447b-82df-328e45a02374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:33.456101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cbbbf-b8e9-447b-82df-328e45a02374 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:33.462201 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 81/167] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:33 2022] GET /identity/v3/role_assignments?user.id=6544ace43e54452fa059337ba0542217&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:33.463574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cbbbf-b8e9-447b-82df-328e45a02374 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:33.514985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:33.520402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b47e5a-3d6a-4e63-aa65-c942858656cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:33.521069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b47e5a-3d6a-4e63-aa65-c942858656cf None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.521352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b47e5a-3d6a-4e63-aa65-c942858656cf None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.521627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b47e5a-3d6a-4e63-aa65-c942858656cf None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:33.527193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b47e5a-3d6a-4e63-aa65-c942858656cf None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:33.528696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b47e5a-3d6a-4e63-aa65-c942858656cf None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:33.530518 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 87/168] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:33 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:33.531304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b47e5a-3d6a-4e63-aa65-c942858656cf None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:33.592898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cbbbf-b8e9-447b-82df-328e45a02374 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:33.631829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:33.674651 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ac1d7-b947-4278-aebc-ab94aec20c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:33.675191 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ac1d7-b947-4278-aebc-ab94aec20c2f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.675472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ac1d7-b947-4278-aebc-ab94aec20c2f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.675860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ac1d7-b947-4278-aebc-ab94aec20c2f None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:33.676452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ac1d7-b947-4278-aebc-ab94aec20c2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:33.680809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ac1d7-b947-4278-aebc-ab94aec20c2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:33.684866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ac1d7-b947-4278-aebc-ab94aec20c2f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:33.706957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 82/169] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:33.707850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ac1d7-b947-4278-aebc-ab94aec20c2f None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:33.786693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b47e5a-3d6a-4e63-aa65-c942858656cf None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:33.856568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1cc81-47db-49c3-9315-9b1981038a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:33.857211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1cc81-47db-49c3-9315-9b1981038a57 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:33.857496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1cc81-47db-49c3-9315-9b1981038a57 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:33.857771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1cc81-47db-49c3-9315-9b1981038a57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:33.869457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b1cc81-47db-49c3-9315-9b1981038a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-73b1cc81-47db-49c3-9315-9b1981038a57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:33.874380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:33.875260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:33.876102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 88/170] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:33.876761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1cc81-47db-49c3-9315-9b1981038a57 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:33.915068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ac1d7-b947-4278-aebc-ab94aec20c2f None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:33.927933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:33.978565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:33.985462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1cc81-47db-49c3-9315-9b1981038a57 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.001547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c142009-f3a2-4216-885e-0e56abbab470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.002172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c142009-f3a2-4216-885e-0e56abbab470 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.002444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c142009-f3a2-4216-885e-0e56abbab470 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.002715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c142009-f3a2-4216-885e-0e56abbab470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.003449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c142009-f3a2-4216-885e-0e56abbab470 None admin] RBAC: Adding query filter params (role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=f523dae04dcf427480a7d92c16eb5781, user.id=60efaef5a97045e9b275fbdb11feb3ff) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:34.007861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c142009-f3a2-4216-885e-0e56abbab470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.009437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c142009-f3a2-4216-885e-0e56abbab470 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.020725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 83/171] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:33 2022] GET /identity/v3/role_assignments?user.id=60efaef5a97045e9b275fbdb11feb3ff&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 608 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:34.021581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c142009-f3a2-4216-885e-0e56abbab470 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.022198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ba1e9-6f3a-4778-9e67-2e00852c3168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.022846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ba1e9-6f3a-4778-9e67-2e00852c3168 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.023131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ba1e9-6f3a-4778-9e67-2e00852c3168 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.023411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257ba1e9-6f3a-4778-9e67-2e00852c3168 None admin] PATH_INFO: `/v3/users/60efaef5a97045e9b275fbdb11feb3ff` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.024596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ba1e9-6f3a-4778-9e67-2e00852c3168 None admin] RBAC: Authorizing `identity:get_user(user_id=60efaef5a97045e9b275fbdb11feb3ff)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.026099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257ba1e9-6f3a-4778-9e67-2e00852c3168 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.028066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 89/172] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:33 2022] GET /identity/v3/users/60efaef5a97045e9b275fbdb11feb3ff => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:34.036711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ba1e9-6f3a-4778-9e67-2e00852c3168 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.176922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257ba1e9-6f3a-4778-9e67-2e00852c3168 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.233069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd9f85-b966-484c-84d2-ba2b767ffd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.234375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd9f85-b966-484c-84d2-ba2b767ffd6e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.235025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd9f85-b966-484c-84d2-ba2b767ffd6e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.235712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd9f85-b966-484c-84d2-ba2b767ffd6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.255083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c142009-f3a2-4216-885e-0e56abbab470 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.307396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f70947-6d53-4875-bd55-5aa68954500a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.308055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f70947-6d53-4875-bd55-5aa68954500a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.308330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f70947-6d53-4875-bd55-5aa68954500a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.308600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f70947-6d53-4875-bd55-5aa68954500a None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.309052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:34.309279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f70947-6d53-4875-bd55-5aa68954500a None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:34.309582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f70947-6d53-4875-bd55-5aa68954500a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.311251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f70947-6d53-4875-bd55-5aa68954500a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.322830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd9f85-b966-484c-84d2-ba2b767ffd6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.324379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd9f85-b966-484c-84d2-ba2b767ffd6e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.331909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 84/173] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:34.336840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f70947-6d53-4875-bd55-5aa68954500a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.395347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:34.436395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 90/174] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:34.442383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd9f85-b966-484c-84d2-ba2b767ffd6e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.499184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f70947-6d53-4875-bd55-5aa68954500a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.536044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:34.563295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd9f85-b966-484c-84d2-ba2b767ffd6e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.571537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc045ef-e68e-4462-8682-308865419abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.571537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc045ef-e68e-4462-8682-308865419abb None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.571537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc045ef-e68e-4462-8682-308865419abb None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.571537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc045ef-e68e-4462-8682-308865419abb None admin] PATH_INFO: `/v3/users/60efaef5a97045e9b275fbdb11feb3ff` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.572231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc045ef-e68e-4462-8682-308865419abb None admin] RBAC: Authorizing `identity:get_user(user_id=60efaef5a97045e9b275fbdb11feb3ff)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.572966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc045ef-e68e-4462-8682-308865419abb None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.575013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 85/175] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/users/60efaef5a97045e9b275fbdb11feb3ff => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:34.587878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc045ef-e68e-4462-8682-308865419abb None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.625793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28789daa-247b-4822-b361-332b81d75cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.626471 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28789daa-247b-4822-b361-332b81d75cad None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.626763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28789daa-247b-4822-b361-332b81d75cad None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.627143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28789daa-247b-4822-b361-332b81d75cad None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.629648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28789daa-247b-4822-b361-332b81d75cad None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.631226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28789daa-247b-4822-b361-332b81d75cad None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.632907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 91/176] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:34.638908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28789daa-247b-4822-b361-332b81d75cad None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:34.739198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:34.743047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc045ef-e68e-4462-8682-308865419abb None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.778975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7acbef-c9b9-4ef0-a02d-636ce23f9ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.779533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7acbef-c9b9-4ef0-a02d-636ce23f9ace None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.779829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7acbef-c9b9-4ef0-a02d-636ce23f9ace None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.780100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7acbef-c9b9-4ef0-a02d-636ce23f9ace None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.790498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28789daa-247b-4822-b361-332b81d75cad None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:34.827889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:34.836115 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192f248-7d4a-47d8-85a8-d57042b77368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:34.836839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192f248-7d4a-47d8-85a8-d57042b77368 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.837132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192f248-7d4a-47d8-85a8-d57042b77368 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.838011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192f248-7d4a-47d8-85a8-d57042b77368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.838710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192f248-7d4a-47d8-85a8-d57042b77368 None admin] RBAC: Adding query filter params (role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=f523dae04dcf427480a7d92c16eb5781, user.id=60efaef5a97045e9b275fbdb11feb3ff) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:34.839033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192f248-7d4a-47d8-85a8-d57042b77368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.840774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192f248-7d4a-47d8-85a8-d57042b77368 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.847530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 92/177] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/role_assignments?user.id=60efaef5a97045e9b275fbdb11feb3ff&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:34.853200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fb4a2-0498-4179-a3bc-53c59733704f None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.853493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fb4a2-0498-4179-a3bc-53c59733704f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.853774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47fb4a2-0498-4179-a3bc-53c59733704f None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.855298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 93/178] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:34.861009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf18c3d-0452-4612-a6fc-ab4056d4c00f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:34.861308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf18c3d-0452-4612-a6fc-ab4056d4c00f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:34.861562 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf18c3d-0452-4612-a6fc-ab4056d4c00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:34.891112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7acbef-c9b9-4ef0-a02d-636ce23f9ace None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:34.893640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7acbef-c9b9-4ef0-a02d-636ce23f9ace None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:34.901230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-fdf18c3d-0452-4612-a6fc-ab4056d4c00f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:34.902538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fdf18c3d-0452-4612-a6fc-ab4056d4c00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:35.007699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.013682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 86/179] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:35.016430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa57d-57f8-4908-b988-c967f4516c44 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.016430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa57d-57f8-4908-b988-c967f4516c44 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.016430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9fa57d-57f8-4908-b988-c967f4516c44 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.017273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 87/180] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:35.018768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa57d-57f8-4908-b988-c967f4516c44 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.069881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 94/181] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:35.071096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a339f-ff79-4df6-99f8-93b383dfcd5a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.071387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a339f-ff79-4df6-99f8-93b383dfcd5a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.071756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a339f-ff79-4df6-99f8-93b383dfcd5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.104653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-311a339f-ff79-4df6-99f8-93b383dfcd5a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:35.105988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-311a339f-ff79-4df6-99f8-93b383dfcd5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:35.190112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 95/182] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:35.207667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9fa57d-57f8-4908-b988-c967f4516c44 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.265586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724b8cd3-6867-4548-9e3d-3b214017656f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.266240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8cd3-6867-4548-9e3d-3b214017656f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.266520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8cd3-6867-4548-9e3d-3b214017656f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.266792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724b8cd3-6867-4548-9e3d-3b214017656f None admin] PATH_INFO: `/v3/projects/ad1e9f8886a742ed8e4dae0e08252eba` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.272469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8cd3-6867-4548-9e3d-3b214017656f None admin] RBAC: Authorizing `identity:get_project(project_id=ad1e9f8886a742ed8e4dae0e08252eba)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:35.273973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724b8cd3-6867-4548-9e3d-3b214017656f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:35.276188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 88/183] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/projects/ad1e9f8886a742ed8e4dae0e08252eba => generated 312 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:35.281945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a339f-ff79-4df6-99f8-93b383dfcd5a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.340164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42980901-25d6-4e64-ad52-7a09eba68562 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.340462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42980901-25d6-4e64-ad52-7a09eba68562 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.340632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42980901-25d6-4e64-ad52-7a09eba68562 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.342249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 89/184] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:35.347179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a0af-69a9-48f6-a90d-42532d87bd4f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.347461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a0af-69a9-48f6-a90d-42532d87bd4f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.347781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266a0af-69a9-48f6-a90d-42532d87bd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.361177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.373498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-6266a0af-69a9-48f6-a90d-42532d87bd4f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:35.381330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6266a0af-69a9-48f6-a90d-42532d87bd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:35.449491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.449710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a339f-ff79-4df6-99f8-93b383dfcd5a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.458941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 90/185] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:35.462356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3373e-b801-4f3d-a8a0-2da9c9a91f33 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.462827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3373e-b801-4f3d-a8a0-2da9c9a91f33 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.463300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3373e-b801-4f3d-a8a0-2da9c9a91f33 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.465217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 91/186] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:35.471502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a31ab-b81e-4815-942f-ac8a6d9ecd6f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.472004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a31ab-b81e-4815-942f-ac8a6d9ecd6f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.472437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a31ab-b81e-4815-942f-ac8a6d9ecd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.501183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-519a31ab-b81e-4815-942f-ac8a6d9ecd6f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:35.502474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-519a31ab-b81e-4815-942f-ac8a6d9ecd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:35.507078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0c276-c7f2-425b-937e-00cb4f672afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.507963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0c276-c7f2-425b-937e-00cb4f672afe None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.508447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0c276-c7f2-425b-937e-00cb4f672afe None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.508912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0c276-c7f2-425b-937e-00cb4f672afe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.509923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0c276-c7f2-425b-937e-00cb4f672afe None admin] RBAC: Adding query filter params (role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=ad1e9f8886a742ed8e4dae0e08252eba, user.id=60efaef5a97045e9b275fbdb11feb3ff) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:35.510426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0c276-c7f2-425b-937e-00cb4f672afe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:35.512513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0c276-c7f2-425b-937e-00cb4f672afe None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:35.522520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 96/187] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/role_assignments?user.id=60efaef5a97045e9b275fbdb11feb3ff&scope.project.id=ad1e9f8886a742ed8e4dae0e08252eba&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:35.524126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0c276-c7f2-425b-937e-00cb4f672afe None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.587480 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 92/188] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:35.653413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0c276-c7f2-425b-937e-00cb4f672afe None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.666946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a31ab-b81e-4815-942f-ac8a6d9ecd6f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.678114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.696368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f079-6640-4f39-b5ef-2dcf6fc8b462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.702001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f079-6640-4f39-b5ef-2dcf6fc8b462 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.702001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f079-6640-4f39-b5ef-2dcf6fc8b462 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.702001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8f079-6640-4f39-b5ef-2dcf6fc8b462 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.711858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe8f079-6640-4f39-b5ef-2dcf6fc8b462 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-ebe8f079-6640-4f39-b5ef-2dcf6fc8b462 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:35.718075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:35.719469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:35.720434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:35.721357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 97/189] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:35.729435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f079-6640-4f39-b5ef-2dcf6fc8b462 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.835901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a31ab-b81e-4815-942f-ac8a6d9ecd6f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.868758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8f079-6640-4f39-b5ef-2dcf6fc8b462 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:35.869254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.882449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaca31-331e-459d-9836-9965fdf685b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.883327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaca31-331e-459d-9836-9965fdf685b7 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.883762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaca31-331e-459d-9836-9965fdf685b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.884278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaca31-331e-459d-9836-9965fdf685b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.885751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaca31-331e-459d-9836-9965fdf685b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:35.887390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaca31-331e-459d-9836-9965fdf685b7 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:35.889326 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 93/190] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:35.890308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaca31-331e-459d-9836-9965fdf685b7 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.909660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8c0f4-a71d-4134-9fb0-88c69c9c6530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:35.910273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8c0f4-a71d-4134-9fb0-88c69c9c6530 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:35.910556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8c0f4-a71d-4134-9fb0-88c69c9c6530 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:35.910830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba8c0f4-a71d-4134-9fb0-88c69c9c6530 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:35.911497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8c0f4-a71d-4134-9fb0-88c69c9c6530 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:35.911828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8c0f4-a71d-4134-9fb0-88c69c9c6530 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:35.913198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba8c0f4-a71d-4134-9fb0-88c69c9c6530 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:35.922261 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 98/191] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:35.922867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8c0f4-a71d-4134-9fb0-88c69c9c6530 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:35.967630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:35.994380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaca31-331e-459d-9836-9965fdf685b7 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.025305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba8c0f4-a71d-4134-9fb0-88c69c9c6530 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.026486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ec01b-2ca6-4727-ab2c-dc5f800d7568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.027113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ec01b-2ca6-4727-ab2c-dc5f800d7568 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.027392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ec01b-2ca6-4727-ab2c-dc5f800d7568 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.027706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ec01b-2ca6-4727-ab2c-dc5f800d7568 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.037390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57ec01b-2ca6-4727-ab2c-dc5f800d7568 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-d57ec01b-2ca6-4727-ab2c-dc5f800d7568 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:36.043156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:36.044221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:36.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 94/192] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:36.045740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ec01b-2ca6-4727-ab2c-dc5f800d7568 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.059824 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231239a2-3395-45ff-8f85-1bbdf0017a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.060431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231239a2-3395-45ff-8f85-1bbdf0017a80 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.060714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231239a2-3395-45ff-8f85-1bbdf0017a80 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.060988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231239a2-3395-45ff-8f85-1bbdf0017a80 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.061637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231239a2-3395-45ff-8f85-1bbdf0017a80 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.063070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231239a2-3395-45ff-8f85-1bbdf0017a80 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.098063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.140425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ec01b-2ca6-4727-ab2c-dc5f800d7568 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.170523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 99/193] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:35 2022] POST /identity/v3/users => generated 297 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:36.171410 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231239a2-3395-45ff-8f85-1bbdf0017a80 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.175378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32204895-26e8-425d-be07-f40948afd051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.175378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32204895-26e8-425d-be07-f40948afd051 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.175378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32204895-26e8-425d-be07-f40948afd051 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.175378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32204895-26e8-425d-be07-f40948afd051 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.187314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32204895-26e8-425d-be07-f40948afd051 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-32204895-26e8-425d-be07-f40948afd051 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:36.192563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:36.193532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:36.194307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:36.196028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 95/194] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:36.197570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32204895-26e8-425d-be07-f40948afd051 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.300087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.307161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231239a2-3395-45ff-8f85-1bbdf0017a80 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.314322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32204895-26e8-425d-be07-f40948afd051 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.329989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.346275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501630e-64e4-4e73-b12e-47ac27b202e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.347160 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501630e-64e4-4e73-b12e-47ac27b202e5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.347254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501630e-64e4-4e73-b12e-47ac27b202e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.347713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c501630e-64e4-4e73-b12e-47ac27b202e5 None admin] PATH_INFO: `/v3/users/833935b257834a959891ab304a757a4e` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.354185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e9618-1903-4ad3-b56f-a8ac03fc85aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.355050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e9618-1903-4ad3-b56f-a8ac03fc85aa None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.355331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e9618-1903-4ad3-b56f-a8ac03fc85aa None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.355954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e9618-1903-4ad3-b56f-a8ac03fc85aa None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.356392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e9618-1903-4ad3-b56f-a8ac03fc85aa None admin] RBAC: Adding query filter params (name=reader) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:36.356747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e9618-1903-4ad3-b56f-a8ac03fc85aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.358375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e9618-1903-4ad3-b56f-a8ac03fc85aa None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.363253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501630e-64e4-4e73-b12e-47ac27b202e5 None admin] RBAC: Authorizing `identity:get_user(user_id=833935b257834a959891ab304a757a4e)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.365209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c501630e-64e4-4e73-b12e-47ac27b202e5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.366978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 100/195] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/users/833935b257834a959891ab304a757a4e => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.367908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501630e-64e4-4e73-b12e-47ac27b202e5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.373050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 96/196] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.373802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e9618-1903-4ad3-b56f-a8ac03fc85aa None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.488536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c501630e-64e4-4e73-b12e-47ac27b202e5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.498438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e9618-1903-4ad3-b56f-a8ac03fc85aa None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.531769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9fc80-061d-4a86-82b4-4bdeb490ba6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.531769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9fc80-061d-4a86-82b4-4bdeb490ba6c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.532063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9fc80-061d-4a86-82b4-4bdeb490ba6c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.532317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc9fc80-061d-4a86-82b4-4bdeb490ba6c None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.532963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9fc80-061d-4a86-82b4-4bdeb490ba6c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:36.533277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9fc80-061d-4a86-82b4-4bdeb490ba6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.534671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc9fc80-061d-4a86-82b4-4bdeb490ba6c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.539146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b58ca-4d5a-453d-aed1-35fe7b55981c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.540380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b58ca-4d5a-453d-aed1-35fe7b55981c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.540380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b58ca-4d5a-453d-aed1-35fe7b55981c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.540380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b58ca-4d5a-453d-aed1-35fe7b55981c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.544948 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 101/197] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.548512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9fc80-061d-4a86-82b4-4bdeb490ba6c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.570511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.612518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.650029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b58ca-4d5a-453d-aed1-35fe7b55981c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.652894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b58ca-4d5a-453d-aed1-35fe7b55981c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.665978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc9fc80-061d-4a86-82b4-4bdeb490ba6c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.704257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c38e73-c594-4aba-a2b7-98298c866532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.704896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c38e73-c594-4aba-a2b7-98298c866532 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.705173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c38e73-c594-4aba-a2b7-98298c866532 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.705444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c38e73-c594-4aba-a2b7-98298c866532 None admin] PATH_INFO: `/v3/users/41c56d0aaa05495db0e1f9d5223f4923` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.706624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c38e73-c594-4aba-a2b7-98298c866532 None admin] RBAC: Authorizing `identity:get_user(user_id=41c56d0aaa05495db0e1f9d5223f4923)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.708117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c38e73-c594-4aba-a2b7-98298c866532 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.709702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 102/198] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/users/41c56d0aaa05495db0e1f9d5223f4923 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.710451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c38e73-c594-4aba-a2b7-98298c866532 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.794475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 97/199] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:36.795704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b58ca-4d5a-453d-aed1-35fe7b55981c None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.808001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.824688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c38e73-c594-4aba-a2b7-98298c866532 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.861426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f931c03-6148-446f-81d6-f1da958ac9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.862067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f931c03-6148-446f-81d6-f1da958ac9dc None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.862357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f931c03-6148-446f-81d6-f1da958ac9dc None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.862630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f931c03-6148-446f-81d6-f1da958ac9dc None admin] PATH_INFO: `/v3/users/833935b257834a959891ab304a757a4e` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.863976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f931c03-6148-446f-81d6-f1da958ac9dc None admin] RBAC: Authorizing `identity:get_user(user_id=833935b257834a959891ab304a757a4e)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:36.865439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f931c03-6148-446f-81d6-f1da958ac9dc None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:36.872305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 103/200] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/users/833935b257834a959891ab304a757a4e => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:36.873238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f931c03-6148-446f-81d6-f1da958ac9dc None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:36.904138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:36.934156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b58ca-4d5a-453d-aed1-35fe7b55981c None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:36.974573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4b2c3-d81a-47b0-9744-973ba6ca0144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:36.975559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4b2c3-d81a-47b0-9744-973ba6ca0144 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:36.976321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4b2c3-d81a-47b0-9744-973ba6ca0144 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:36.977316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4b2c3-d81a-47b0-9744-973ba6ca0144 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:36.980396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f931c03-6148-446f-81d6-f1da958ac9dc None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.022489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b572b-ff9f-4d99-aed5-1be02ee9daa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.023557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b572b-ff9f-4d99-aed5-1be02ee9daa5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.023969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b572b-ff9f-4d99-aed5-1be02ee9daa5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.024341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011b572b-ff9f-4d99-aed5-1be02ee9daa5 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.026210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b572b-ff9f-4d99-aed5-1be02ee9daa5 None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.028283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011b572b-ff9f-4d99-aed5-1be02ee9daa5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.031225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 104/201] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:37.032677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b572b-ff9f-4d99-aed5-1be02ee9daa5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.058937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4b2c3-d81a-47b0-9744-973ba6ca0144 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.060680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4b2c3-d81a-47b0-9744-973ba6ca0144 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.062258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.150384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011b572b-ff9f-4d99-aed5-1be02ee9daa5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.156838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.187857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ca286-9413-4585-b210-c055649cd91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.188200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 98/202] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:37.188630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ca286-9413-4585-b210-c055649cd91d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.188979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ca286-9413-4585-b210-c055649cd91d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.189088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4b2c3-d81a-47b0-9744-973ba6ca0144 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.189375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723ca286-9413-4585-b210-c055649cd91d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.265817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ca286-9413-4585-b210-c055649cd91d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.267462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723ca286-9413-4585-b210-c055649cd91d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.292086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.326429 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4b2c3-d81a-47b0-9744-973ba6ca0144 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.373182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a36dd-6ec3-456d-af66-88d2839fae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.373943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a36dd-6ec3-456d-af66-88d2839fae03 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.374316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a36dd-6ec3-456d-af66-88d2839fae03 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.374706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1a36dd-6ec3-456d-af66-88d2839fae03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.375608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a36dd-6ec3-456d-af66-88d2839fae03 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=d99f908d7e3746a5a68fca96958c366c, user.id=833935b257834a959891ab304a757a4e) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:37.376078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a36dd-6ec3-456d-af66-88d2839fae03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.377935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1a36dd-6ec3-456d-af66-88d2839fae03 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.383406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 105/203] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:37.384309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ca286-9413-4585-b210-c055649cd91d None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.388633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 99/204] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/role_assignments?user.id=833935b257834a959891ab304a757a4e&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:37.389471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a36dd-6ec3-456d-af66-88d2839fae03 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.463165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.510738 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723ca286-9413-4585-b210-c055649cd91d None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.535732 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.552286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d766b14-e8fd-48fc-954d-965269f63eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.555891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d766b14-e8fd-48fc-954d-965269f63eba None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.555891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d766b14-e8fd-48fc-954d-965269f63eba None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.555891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d766b14-e8fd-48fc-954d-965269f63eba None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.555891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d766b14-e8fd-48fc-954d-965269f63eba None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.556730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d766b14-e8fd-48fc-954d-965269f63eba None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.558690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 106/205] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:37.565679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d766b14-e8fd-48fc-954d-965269f63eba None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.617079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1a36dd-6ec3-456d-af66-88d2839fae03 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.683704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4234dd8-6335-40ca-9087-4fc084577bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.684605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4234dd8-6335-40ca-9087-4fc084577bef None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.685056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4234dd8-6335-40ca-9087-4fc084577bef None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.685486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4234dd8-6335-40ca-9087-4fc084577bef None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.687326 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4234dd8-6335-40ca-9087-4fc084577bef None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.689839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4234dd8-6335-40ca-9087-4fc084577bef None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.692350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 100/206] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:37.699542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4234dd8-6335-40ca-9087-4fc084577bef None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:37.732576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d766b14-e8fd-48fc-954d-965269f63eba None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.808434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af72ea5-c532-437e-af85-434dbe5292ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.809044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72ea5-c532-437e-af85-434dbe5292ce None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.809472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72ea5-c532-437e-af85-434dbe5292ce None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.809767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af72ea5-c532-437e-af85-434dbe5292ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.810629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af72ea5-c532-437e-af85-434dbe5292ce None admin] RBAC: Adding query filter params (role.id=43b28df8274a4b678cfbbb3d8eac0f52, scope.project.id=f523dae04dcf427480a7d92c16eb5781, user.id=41c56d0aaa05495db0e1f9d5223f4923) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:37.810945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af72ea5-c532-437e-af85-434dbe5292ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:37.812911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af72ea5-c532-437e-af85-434dbe5292ce None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:37.823219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 107/207] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/role_assignments?user.id=41c56d0aaa05495db0e1f9d5223f4923&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=43b28df8274a4b678cfbbb3d8eac0f52 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:37.946938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4234dd8-6335-40ca-9087-4fc084577bef None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:37.960216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:37.995455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6675633e-4149-4c93-a528-c4dbe349fb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:37.996469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675633e-4149-4c93-a528-c4dbe349fb00 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:37.996983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675633e-4149-4c93-a528-c4dbe349fb00 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:37.997509 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6675633e-4149-4c93-a528-c4dbe349fb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:37.998458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675633e-4149-4c93-a528-c4dbe349fb00 None admin] RBAC: Adding query filter params (role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=d99f908d7e3746a5a68fca96958c366c, user.id=833935b257834a959891ab304a757a4e) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:37.999000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675633e-4149-4c93-a528-c4dbe349fb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:38.000692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6675633e-4149-4c93-a528-c4dbe349fb00 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:38.012810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 101/208] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:37 2022] GET /identity/v3/role_assignments?user.id=833935b257834a959891ab304a757a4e&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:38.519860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73701c6-b999-4e5c-b8b3-f798e6373b47 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:38.520396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73701c6-b999-4e5c-b8b3-f798e6373b47 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:38.520396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73701c6-b999-4e5c-b8b3-f798e6373b47 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:38.521895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 108/209] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:38.528317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999d02-8b93-4e47-b4c3-a47344300d63 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:38.528953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999d02-8b93-4e47-b4c3-a47344300d63 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:38.529433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03999d02-8b93-4e47-b4c3-a47344300d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:38.551622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-03999d02-8b93-4e47-b4c3-a47344300d63 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:38.552895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-03999d02-8b93-4e47-b4c3-a47344300d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:38.625649 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 102/210] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:38.683345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56e74d-c450-470e-a9c8-145339e57575 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:38.683655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56e74d-c450-470e-a9c8-145339e57575 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:38.683964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56e74d-c450-470e-a9c8-145339e57575 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:38.685323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 109/211] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:38.690594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2128-cdf6-47d1-bde1-28315254ce74 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:38.690886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2128-cdf6-47d1-bde1-28315254ce74 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:38.691247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15de2128-cdf6-47d1-bde1-28315254ce74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:38.710080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-15de2128-cdf6-47d1-bde1-28315254ce74 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:38.711277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-15de2128-cdf6-47d1-bde1-28315254ce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:38.787031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 103/212] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:38.904528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56e74d-c450-470e-a9c8-145339e57575 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:38.964209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:39.014206 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56e74d-c450-470e-a9c8-145339e57575 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:39.047966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4f19-8776-48d4-b769-a8fa758d1ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:39.048588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4f19-8776-48d4-b769-a8fa758d1ea5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.048875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4f19-8776-48d4-b769-a8fa758d1ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.049151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b4f19-8776-48d4-b769-a8fa758d1ea5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.060556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8b4f19-8776-48d4-b769-a8fa758d1ea5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-1b8b4f19-8776-48d4-b769-a8fa758d1ea5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:39.065937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:39.066832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:39.068701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 110/213] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:39.073512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2128-cdf6-47d1-bde1-28315254ce74 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:39.089784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4f19-8776-48d4-b769-a8fa758d1ea5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:39.107698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:39.184770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15de2128-cdf6-47d1-bde1-28315254ce74 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:39.192761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8b4f19-8776-48d4-b769-a8fa758d1ea5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:39.205741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:39.222655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e8d26-7f6f-44bd-87aa-4dce7a6be50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:39.223627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e8d26-7f6f-44bd-87aa-4dce7a6be50d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.224173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e8d26-7f6f-44bd-87aa-4dce7a6be50d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.224606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498e8d26-7f6f-44bd-87aa-4dce7a6be50d None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.231664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e8d26-7f6f-44bd-87aa-4dce7a6be50d None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:39.231664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e8d26-7f6f-44bd-87aa-4dce7a6be50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:39.231873 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025fce5-22dd-47a0-84e8-9de6e48cf7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:39.231975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498e8d26-7f6f-44bd-87aa-4dce7a6be50d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:39.232058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025fce5-22dd-47a0-84e8-9de6e48cf7a6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.232058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025fce5-22dd-47a0-84e8-9de6e48cf7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.232058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6025fce5-22dd-47a0-84e8-9de6e48cf7a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.232058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025fce5-22dd-47a0-84e8-9de6e48cf7a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:39.232058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6025fce5-22dd-47a0-84e8-9de6e48cf7a6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:39.237517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 104/215] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:39.237767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 111/215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:39.240574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e8d26-7f6f-44bd-87aa-4dce7a6be50d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:39.243118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025fce5-22dd-47a0-84e8-9de6e48cf7a6 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:39.354698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:39.361220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498e8d26-7f6f-44bd-87aa-4dce7a6be50d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:39.386011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6025fce5-22dd-47a0-84e8-9de6e48cf7a6 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:39.397792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd31482-b173-4c51-9fdf-2af25145e511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:39.398522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd31482-b173-4c51-9fdf-2af25145e511 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.398898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd31482-b173-4c51-9fdf-2af25145e511 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.399284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd31482-b173-4c51-9fdf-2af25145e511 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.400077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd31482-b173-4c51-9fdf-2af25145e511 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:39.401603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd31482-b173-4c51-9fdf-2af25145e511 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:39.426749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c15c82-5cf9-40f9-8d92-b6610dca0fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:39.431431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c15c82-5cf9-40f9-8d92-b6610dca0fbd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.431431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c15c82-5cf9-40f9-8d92-b6610dca0fbd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.431431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c15c82-5cf9-40f9-8d92-b6610dca0fbd None admin] PATH_INFO: `/v3/users/4ad21fcd84cc4e61a0d7e729feecf90d` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.442707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c15c82-5cf9-40f9-8d92-b6610dca0fbd None admin] RBAC: Authorizing `identity:get_user(user_id=4ad21fcd84cc4e61a0d7e729feecf90d)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:39.444169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c15c82-5cf9-40f9-8d92-b6610dca0fbd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:39.447065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 112/216] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:39 2022] GET /identity/v3/users/4ad21fcd84cc4e61a0d7e729feecf90d => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:39.451590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c15c82-5cf9-40f9-8d92-b6610dca0fbd None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:39.492149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:39.508170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 105/217] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:39 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:39.578368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c15c82-5cf9-40f9-8d92-b6610dca0fbd None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:39.621218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e567e0b6-f7d7-4c67-9d4e-4777f546c66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:39.622160 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e0b6-f7d7-4c67-9d4e-4777f546c66d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.622604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e0b6-f7d7-4c67-9d4e-4777f546c66d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.623010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567e0b6-f7d7-4c67-9d4e-4777f546c66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.700117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e0b6-f7d7-4c67-9d4e-4777f546c66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:39.701668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e567e0b6-f7d7-4c67-9d4e-4777f546c66d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:39.745913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:39.815878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 113/218] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:32:39.822513 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd31482-b173-4c51-9fdf-2af25145e511 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:39.898430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e91a2-16eb-476d-be9c-9c9172a5110d None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.899022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e91a2-16eb-476d-be9c-9c9172a5110d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.899617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e91a2-16eb-476d-be9c-9c9172a5110d None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.901694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 114/219] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:39.907631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd0c5-782f-4c87-b458-5d5f186886eb None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.908144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd0c5-782f-4c87-b458-5d5f186886eb None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:39.908633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92dd0c5-782f-4c87-b458-5d5f186886eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:39.929172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d92dd0c5-782f-4c87-b458-5d5f186886eb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:39.931050 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d92dd0c5-782f-4c87-b458-5d5f186886eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:39.954681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd31482-b173-4c51-9fdf-2af25145e511 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:39.998046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524de19-038c-439b-af3e-ce98b2b6e16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:39.999049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524de19-038c-439b-af3e-ce98b2b6e16e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:39.999563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524de19-038c-439b-af3e-ce98b2b6e16e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.000064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4524de19-038c-439b-af3e-ce98b2b6e16e None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.001521 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524de19-038c-439b-af3e-ce98b2b6e16e None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:40.003225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4524de19-038c-439b-af3e-ce98b2b6e16e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:40.005497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 106/220] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:39 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:40.012106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 115/221] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:40.019535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524de19-038c-439b-af3e-ce98b2b6e16e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:40.040821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:40.126762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4524de19-038c-439b-af3e-ce98b2b6e16e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:40.163863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4cacb4-86cd-4ed8-b987-7f843dfbb0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:40.164388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cacb4-86cd-4ed8-b987-7f843dfbb0dd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.164666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cacb4-86cd-4ed8-b987-7f843dfbb0dd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.165516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4cacb4-86cd-4ed8-b987-7f843dfbb0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.166253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cacb4-86cd-4ed8-b987-7f843dfbb0dd None admin] RBAC: Adding query filter params (role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=d99f908d7e3746a5a68fca96958c366c, user.id=4ad21fcd84cc4e61a0d7e729feecf90d) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:40.166557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cacb4-86cd-4ed8-b987-7f843dfbb0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:40.168006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4cacb4-86cd-4ed8-b987-7f843dfbb0dd None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:40.173908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 107/222] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:40 2022] GET /identity/v3/role_assignments?user.id=4ad21fcd84cc4e61a0d7e729feecf90d&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:40.302178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dd0c5-782f-4c87-b458-5d5f186886eb None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:40.394135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:40.437778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92dd0c5-782f-4c87-b458-5d5f186886eb None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:40.474611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6e2ae-461c-4294-bb14-ea481537ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:40.475648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6e2ae-461c-4294-bb14-ea481537ff3e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.476142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6e2ae-461c-4294-bb14-ea481537ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.476603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc6e2ae-461c-4294-bb14-ea481537ff3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.487882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc6e2ae-461c-4294-bb14-ea481537ff3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:40.490119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580fa1-5192-42aa-81d5-0b369a46f41c None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.490410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580fa1-5192-42aa-81d5-0b369a46f41c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.490683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd580fa1-5192-42aa-81d5-0b369a46f41c None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.493271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 108/223] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-3bc6e2ae-461c-4294-bb14-ea481537ff3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:40.494389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:40.495258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:40.496101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:40.498299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5b162-b5a4-462b-abc8-c5f7e37197d3 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.498583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5b162-b5a4-462b-abc8-c5f7e37197d3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.498854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 116/224] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:40.499043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5b162-b5a4-462b-abc8-c5f7e37197d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.509163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6e2ae-461c-4294-bb14-ea481537ff3e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:40.533720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9de5b162-b5a4-462b-abc8-c5f7e37197d3 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:40.534905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9de5b162-b5a4-462b-abc8-c5f7e37197d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:40.651940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 109/225] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:40.697788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc6e2ae-461c-4294-bb14-ea481537ff3e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:40.734714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:40.744316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e17a9-ae8f-4f2e-9582-f31409a97679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:40.755956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e17a9-ae8f-4f2e-9582-f31409a97679 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.755956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e17a9-ae8f-4f2e-9582-f31409a97679 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.755956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e17a9-ae8f-4f2e-9582-f31409a97679 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.755956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e17a9-ae8f-4f2e-9582-f31409a97679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:40.755956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e17a9-ae8f-4f2e-9582-f31409a97679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:40.755956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1e17a9-ae8f-4f2e-9582-f31409a97679 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:40.760093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 117/226] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:40.766068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5b162-b5a4-462b-abc8-c5f7e37197d3 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:40.782814 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:40.874863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5b162-b5a4-462b-abc8-c5f7e37197d3 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:40.920346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d9901-daf6-4cc5-aa68-7014a7489380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:40.920986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d9901-daf6-4cc5-aa68-7014a7489380 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:40.921264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d9901-daf6-4cc5-aa68-7014a7489380 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:40.921538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d9901-daf6-4cc5-aa68-7014a7489380 None admin] PATH_INFO: `/v3/users/833935b257834a959891ab304a757a4e` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:40.922656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d9901-daf6-4cc5-aa68-7014a7489380 None admin] RBAC: Authorizing `identity:get_user(user_id=833935b257834a959891ab304a757a4e)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:40.924118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d9901-daf6-4cc5-aa68-7014a7489380 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:40.925856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 110/227] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:40 2022] GET /identity/v3/users/833935b257834a959891ab304a757a4e => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:40.931725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e17a9-ae8f-4f2e-9582-f31409a97679 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.071762 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e17a9-ae8f-4f2e-9582-f31409a97679 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.100113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d9901-daf6-4cc5-aa68-7014a7489380 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.128214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e5da6-04b2-4eee-9cc3-5ec7c7d58c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.128860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e5da6-04b2-4eee-9cc3-5ec7c7d58c5f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.129143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e5da6-04b2-4eee-9cc3-5ec7c7d58c5f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.129463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e5da6-04b2-4eee-9cc3-5ec7c7d58c5f None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.130694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e5da6-04b2-4eee-9cc3-5ec7c7d58c5f None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.132027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e5da6-04b2-4eee-9cc3-5ec7c7d58c5f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.134691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 118/228] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:40 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:41.140168 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e5da6-04b2-4eee-9cc3-5ec7c7d58c5f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.200522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.214348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d9901-daf6-4cc5-aa68-7014a7489380 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.256971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b2cf5-311e-4a2b-83d0-0c9716f7bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.258144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b2cf5-311e-4a2b-83d0-0c9716f7bf4a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.259871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b2cf5-311e-4a2b-83d0-0c9716f7bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.260350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b2cf5-311e-4a2b-83d0-0c9716f7bf4a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.277201 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b2cf5-311e-4a2b-83d0-0c9716f7bf4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:41.281223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-944b2cf5-311e-4a2b-83d0-0c9716f7bf4a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:41.284354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:41.285209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:41.286001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:41.289695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 111/229] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:32:41.295458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b2cf5-311e-4a2b-83d0-0c9716f7bf4a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.411964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b2cf5-311e-4a2b-83d0-0c9716f7bf4a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.441676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e5da6-04b2-4eee-9cc3-5ec7c7d58c5f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.462199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d7802-bcd0-4b34-ad4f-9c4cdaf32bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.463058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d7802-bcd0-4b34-ad4f-9c4cdaf32bfd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.463486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d7802-bcd0-4b34-ad4f-9c4cdaf32bfd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.463948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820d7802-bcd0-4b34-ad4f-9c4cdaf32bfd None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.465064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d7802-bcd0-4b34-ad4f-9c4cdaf32bfd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:41.465426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d7802-bcd0-4b34-ad4f-9c4cdaf32bfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.466823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820d7802-bcd0-4b34-ad4f-9c4cdaf32bfd None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.475930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caab1f-4adb-4194-9f03-bbbd6eff6930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.476817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caab1f-4adb-4194-9f03-bbbd6eff6930 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.477906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caab1f-4adb-4194-9f03-bbbd6eff6930 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.478359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3caab1f-4adb-4194-9f03-bbbd6eff6930 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c/users/833935b257834a959891ab304a757a4e/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.480523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caab1f-4adb-4194-9f03-bbbd6eff6930 None admin] RBAC: Authorizing `identity:create_grant(project_id=d99f908d7e3746a5a68fca96958c366c, user_id=833935b257834a959891ab304a757a4e, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.481926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 112/230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:41.482671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3caab1f-4adb-4194-9f03-bbbd6eff6930 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.488502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d7802-bcd0-4b34-ad4f-9c4cdaf32bfd None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.491619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.556731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 119/231] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:41 2022] PUT /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c/users/833935b257834a959891ab304a757a4e/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:32:41.621913 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820d7802-bcd0-4b34-ad4f-9c4cdaf32bfd None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.673693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9c317-7745-46c0-8a49-45bea29faadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.674272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9c317-7745-46c0-8a49-45bea29faadc None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.674557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9c317-7745-46c0-8a49-45bea29faadc None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.674894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9c317-7745-46c0-8a49-45bea29faadc None admin] PATH_INFO: `/v3/users/833935b257834a959891ab304a757a4e` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.676125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9c317-7745-46c0-8a49-45bea29faadc None admin] RBAC: Authorizing `identity:get_user(user_id=833935b257834a959891ab304a757a4e)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.677565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9c317-7745-46c0-8a49-45bea29faadc None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.679855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 113/232] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/users/833935b257834a959891ab304a757a4e => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:41.685626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caab1f-4adb-4194-9f03-bbbd6eff6930 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.824769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3caab1f-4adb-4194-9f03-bbbd6eff6930 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:41.848407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.873378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0538c41d-76d4-459b-992c-16879ca6bdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:41.874465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538c41d-76d4-459b-992c-16879ca6bdd2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:41.874950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538c41d-76d4-459b-992c-16879ca6bdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:41.875420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0538c41d-76d4-459b-992c-16879ca6bdd2 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:41.880275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538c41d-76d4-459b-992c-16879ca6bdd2 None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:41.881758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0538c41d-76d4-459b-992c-16879ca6bdd2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:41.883770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 120/233] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:41 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:41.889474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9c317-7745-46c0-8a49-45bea29faadc None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:41.964010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:41.996465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9c317-7745-46c0-8a49-45bea29faadc None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:42.033119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e8485-35d3-4f80-b26e-29240ff0a8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:42.033834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e8485-35d3-4f80-b26e-29240ff0a8ca None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.034120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e8485-35d3-4f80-b26e-29240ff0a8ca None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.034398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e8485-35d3-4f80-b26e-29240ff0a8ca None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c/users/833935b257834a959891ab304a757a4e/roles/8715982a4ad3427498d1a73a6891b4d3` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.036743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e8485-35d3-4f80-b26e-29240ff0a8ca None admin] RBAC: Authorizing `identity:create_grant(project_id=d99f908d7e3746a5a68fca96958c366c, user_id=833935b257834a959891ab304a757a4e, role_id=8715982a4ad3427498d1a73a6891b4d3)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:42.038127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e8485-35d3-4f80-b26e-29240ff0a8ca None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:42.145999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 114/234] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:41 2022] PUT /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c/users/833935b257834a959891ab304a757a4e/roles/8715982a4ad3427498d1a73a6891b4d3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:42.223705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1f7e2-d579-489d-84d2-3dc1928211cf None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.223985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1f7e2-d579-489d-84d2-3dc1928211cf None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.224185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1f7e2-d579-489d-84d2-3dc1928211cf None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.225875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 121/235] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:42.232284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515bbb8-b164-4029-a7c6-95adcefa80f8 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.233208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515bbb8-b164-4029-a7c6-95adcefa80f8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.233691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515bbb8-b164-4029-a7c6-95adcefa80f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.260879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8515bbb8-b164-4029-a7c6-95adcefa80f8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:42.262559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8515bbb8-b164-4029-a7c6-95adcefa80f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:42.339727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 115/236] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:42.512743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca515c-21b7-436d-ad0f-88c6ec5bbb27 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.513034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca515c-21b7-436d-ad0f-88c6ec5bbb27 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.513225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca515c-21b7-436d-ad0f-88c6ec5bbb27 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.514580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 122/237] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:42.520570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85f08-0268-40b7-9487-c27ac1292bc8 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.520859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85f08-0268-40b7-9487-c27ac1292bc8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.521138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a85f08-0268-40b7-9487-c27ac1292bc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.547546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-59a85f08-0268-40b7-9487-c27ac1292bc8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:42.549105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-59a85f08-0268-40b7-9487-c27ac1292bc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:42.634779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca515c-21b7-436d-ad0f-88c6ec5bbb27 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:42.638466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:42.657319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 116/238] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:42.781097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca515c-21b7-436d-ad0f-88c6ec5bbb27 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:42.831242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8574ff-806e-4557-9c70-50a4e2b16e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:42.831909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8574ff-806e-4557-9c70-50a4e2b16e9a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:42.832169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8574ff-806e-4557-9c70-50a4e2b16e9a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:42.832502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8574ff-806e-4557-9c70-50a4e2b16e9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:42.853252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8574ff-806e-4557-9c70-50a4e2b16e9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-3e8574ff-806e-4557-9c70-50a4e2b16e9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:42.858884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:42.859871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:42.860674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 123/239] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:42.866261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85f08-0268-40b7-9487-c27ac1292bc8 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:42.993872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8574ff-806e-4557-9c70-50a4e2b16e9a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.000508 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a85f08-0268-40b7-9487-c27ac1292bc8 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.038242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce46e62-a2d8-4b81-9141-136a08c3142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.038781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46e62-a2d8-4b81-9141-136a08c3142a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.039065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46e62-a2d8-4b81-9141-136a08c3142a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.039341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce46e62-a2d8-4b81-9141-136a08c3142a None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.041082 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce46e62-a2d8-4b81-9141-136a08c3142a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:43.041397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce46e62-a2d8-4b81-9141-136a08c3142a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.042780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce46e62-a2d8-4b81-9141-136a08c3142a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.055263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 117/240] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:43.056525 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81e646-6989-4721-9c67-52aabde4023a None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.056810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81e646-6989-4721-9c67-52aabde4023a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.057209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b81e646-6989-4721-9c67-52aabde4023a None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.058557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 118/241] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:43.063270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81e646-6989-4721-9c67-52aabde4023a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.079379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.121855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.146918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8574ff-806e-4557-9c70-50a4e2b16e9a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.178835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b81e646-6989-4721-9c67-52aabde4023a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.196296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37b874-5c27-4e9c-9838-92cedac7d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.196944 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37b874-5c27-4e9c-9838-92cedac7d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.197228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37b874-5c27-4e9c-9838-92cedac7d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.197503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37b874-5c27-4e9c-9838-92cedac7d4a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.199293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37b874-5c27-4e9c-9838-92cedac7d4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.200785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37b874-5c27-4e9c-9838-92cedac7d4a1 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.203463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 124/242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:43.204635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa7d8d-422c-4262-83c8-758abd47f609 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.205182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa7d8d-422c-4262-83c8-758abd47f609 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.205467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fa7d8d-422c-4262-83c8-758abd47f609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.219661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b3136-8206-49c1-afae-9e9e00eda9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.220587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b3136-8206-49c1-afae-9e9e00eda9ff None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.220876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b3136-8206-49c1-afae-9e9e00eda9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.221152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b3136-8206-49c1-afae-9e9e00eda9ff None admin] PATH_INFO: `/v3/users/0f78afa1888b4761b0886af4c9002bb0` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.224553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-88fa7d8d-422c-4262-83c8-758abd47f609 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:43.225704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-88fa7d8d-422c-4262-83c8-758abd47f609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:43.235801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b3136-8206-49c1-afae-9e9e00eda9ff None admin] RBAC: Authorizing `identity:get_user(user_id=0f78afa1888b4761b0886af4c9002bb0)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.237526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b3136-8206-49c1-afae-9e9e00eda9ff None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.239374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 119/243] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/users/0f78afa1888b4761b0886af4c9002bb0 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:43.240756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b3136-8206-49c1-afae-9e9e00eda9ff None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.303817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 125/244] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:43.308324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa7d8d-422c-4262-83c8-758abd47f609 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.388051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b3136-8206-49c1-afae-9e9e00eda9ff None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.399862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.427862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.457109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c1000-56f9-4f17-81e5-3a2ff600fbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.457841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1000-56f9-4f17-81e5-3a2ff600fbf3 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.458182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1000-56f9-4f17-81e5-3a2ff600fbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.458512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3c1000-56f9-4f17-81e5-3a2ff600fbf3 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.459234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c1000-56f9-4f17-81e5-3a2ff600fbf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.460751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3c1000-56f9-4f17-81e5-3a2ff600fbf3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.465481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fa7d8d-422c-4262-83c8-758abd47f609 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.499995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5e4c0-d173-4e6e-b5a5-ea76f9f3e137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.502061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5e4c0-d173-4e6e-b5a5-ea76f9f3e137 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.502061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5e4c0-d173-4e6e-b5a5-ea76f9f3e137 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.502061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be5e4c0-d173-4e6e-b5a5-ea76f9f3e137 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.570220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5e4c0-d173-4e6e-b5a5-ea76f9f3e137 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.574772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be5e4c0-d173-4e6e-b5a5-ea76f9f3e137 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.574901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 120/245] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:43 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:43.621451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.641198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c1000-56f9-4f17-81e5-3a2ff600fbf3 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.683172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 126/246] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:43.689143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5e4c0-d173-4e6e-b5a5-ea76f9f3e137 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.827710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3c1000-56f9-4f17-81e5-3a2ff600fbf3 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.857439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be5e4c0-d173-4e6e-b5a5-ea76f9f3e137 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:43.873363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0944d-0207-4f03-89df-46e18f9dd520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.874879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0944d-0207-4f03-89df-46e18f9dd520 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.875360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0944d-0207-4f03-89df-46e18f9dd520 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.876155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b0944d-0207-4f03-89df-46e18f9dd520 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.889042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b0944d-0207-4f03-89df-46e18f9dd520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-55b0944d-0207-4f03-89df-46e18f9dd520 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:43.897130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:43.898011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:43.898899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:43.900932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 121/247] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:43.901413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e2047-a675-4423-80b1-3000a75f42b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:43.902049 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e2047-a675-4423-80b1-3000a75f42b5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:43.902325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e2047-a675-4423-80b1-3000a75f42b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:43.902589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e2047-a675-4423-80b1-3000a75f42b5 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:43.907587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e2047-a675-4423-80b1-3000a75f42b5 None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:43.907587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e2047-a675-4423-80b1-3000a75f42b5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:43.908570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0944d-0207-4f03-89df-46e18f9dd520 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.908954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 127/248] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:43.913204 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e2047-a675-4423-80b1-3000a75f42b5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:43.932450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:43.942798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:44.044998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b0944d-0207-4f03-89df-46e18f9dd520 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.050876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e2047-a675-4423-80b1-3000a75f42b5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.089978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96c984-86e2-4c5b-bbc7-576529917681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.090522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96c984-86e2-4c5b-bbc7-576529917681 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.090802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96c984-86e2-4c5b-bbc7-576529917681 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.091076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96c984-86e2-4c5b-bbc7-576529917681 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.091775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96c984-86e2-4c5b-bbc7-576529917681 None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:44.092085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96c984-86e2-4c5b-bbc7-576529917681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:44.093463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96c984-86e2-4c5b-bbc7-576529917681 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.096066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d525e0-0501-41fe-9cdf-2a51a8b241cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.096888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d525e0-0501-41fe-9cdf-2a51a8b241cd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.097373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d525e0-0501-41fe-9cdf-2a51a8b241cd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.097834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d525e0-0501-41fe-9cdf-2a51a8b241cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.098805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d525e0-0501-41fe-9cdf-2a51a8b241cd None admin] RBAC: Adding query filter params (role.id=43b28df8274a4b678cfbbb3d8eac0f52, scope.project.id=d99f908d7e3746a5a68fca96958c366c, user.id=0f78afa1888b4761b0886af4c9002bb0) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:44.099304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d525e0-0501-41fe-9cdf-2a51a8b241cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:44.100937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d525e0-0501-41fe-9cdf-2a51a8b241cd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.107342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 128/249] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/role_assignments?user.id=0f78afa1888b4761b0886af4c9002bb0&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=43b28df8274a4b678cfbbb3d8eac0f52 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:44.108375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 122/250] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:44.108746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96c984-86e2-4c5b-bbc7-576529917681 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:44.209826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:44.224316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96c984-86e2-4c5b-bbc7-576529917681 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.270119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581cf2f6-9394-49f1-bb2f-5aa3101bbe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.270790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cf2f6-9394-49f1-bb2f-5aa3101bbe5e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.271047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cf2f6-9394-49f1-bb2f-5aa3101bbe5e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.271328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581cf2f6-9394-49f1-bb2f-5aa3101bbe5e None admin] PATH_INFO: `/v3/users/4ad21fcd84cc4e61a0d7e729feecf90d` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.272553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cf2f6-9394-49f1-bb2f-5aa3101bbe5e None admin] RBAC: Authorizing `identity:get_user(user_id=4ad21fcd84cc4e61a0d7e729feecf90d)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:44.274589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581cf2f6-9394-49f1-bb2f-5aa3101bbe5e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.276656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 123/251] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:44 2022] GET /identity/v3/users/4ad21fcd84cc4e61a0d7e729feecf90d => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:44.282417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d525e0-0501-41fe-9cdf-2a51a8b241cd None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:44.378314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:44.389669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8900f25-daed-4dd3-ad89-d7b91a9884f6 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.389969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8900f25-daed-4dd3-ad89-d7b91a9884f6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.395473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8900f25-daed-4dd3-ad89-d7b91a9884f6 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.395473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 124/252] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:44.397388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1494a-617b-487b-8934-759342084d94 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.397674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1494a-617b-487b-8934-759342084d94 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.397950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c1494a-617b-487b-8934-759342084d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.408638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d525e0-0501-41fe-9cdf-2a51a8b241cd None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.440542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-94c1494a-617b-487b-8934-759342084d94 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:44.441754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-94c1494a-617b-487b-8934-759342084d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:44.447792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca620d-16e1-4a2e-85a3-27fda259f0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.448742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca620d-16e1-4a2e-85a3-27fda259f0e9 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.449303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca620d-16e1-4a2e-85a3-27fda259f0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.449821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca620d-16e1-4a2e-85a3-27fda259f0e9 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.451186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca620d-16e1-4a2e-85a3-27fda259f0e9 None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:44.452886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ca620d-16e1-4a2e-85a3-27fda259f0e9 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.455108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 129/253] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:44 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:44.462672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca620d-16e1-4a2e-85a3-27fda259f0e9 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:44.578789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 125/254] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:44.639387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca620d-16e1-4a2e-85a3-27fda259f0e9 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:44.690577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99e412-f74a-43b4-9454-d1abe964b688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:44.691243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e412-f74a-43b4-9454-d1abe964b688 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:44.691618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e412-f74a-43b4-9454-d1abe964b688 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:44.691894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99e412-f74a-43b4-9454-d1abe964b688 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c/users/4ad21fcd84cc4e61a0d7e729feecf90d/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:44.694534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e412-f74a-43b4-9454-d1abe964b688 None admin] RBAC: Authorizing `identity:create_grant(project_id=d99f908d7e3746a5a68fca96958c366c, user_id=4ad21fcd84cc4e61a0d7e729feecf90d, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:44.696780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99e412-f74a-43b4-9454-d1abe964b688 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:44.791175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 130/255] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:44 2022] PUT /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c/users/4ad21fcd84cc4e61a0d7e729feecf90d/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:45.001861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1494a-617b-487b-8934-759342084d94 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.013015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46d2da-49e0-4f04-a6f1-d84af01f2a5b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.013559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46d2da-49e0-4f04-a6f1-d84af01f2a5b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.013559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46d2da-49e0-4f04-a6f1-d84af01f2a5b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.015086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 131/256] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:45.020850 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412deb5-3dd9-4589-a1b0-cb1a6351ed25 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.021126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412deb5-3dd9-4589-a1b0-cb1a6351ed25 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.021395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412deb5-3dd9-4589-a1b0-cb1a6351ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.040965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.064727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d412deb5-3dd9-4589-a1b0-cb1a6351ed25 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:45.066094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d412deb5-3dd9-4589-a1b0-cb1a6351ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:45.116535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.150036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c1494a-617b-487b-8934-759342084d94 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.183326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 132/257] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:45.205792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6d046-2e40-4846-9bfb-749c8803a555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.206430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6d046-2e40-4846-9bfb-749c8803a555 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.206705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6d046-2e40-4846-9bfb-749c8803a555 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.206974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6d046-2e40-4846-9bfb-749c8803a555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.220099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a6d046-2e40-4846-9bfb-749c8803a555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-80a6d046-2e40-4846-9bfb-749c8803a555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:45.224886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:45.225782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:45.226584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 126/258] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:45.232253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412deb5-3dd9-4589-a1b0-cb1a6351ed25 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.366176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412deb5-3dd9-4589-a1b0-cb1a6351ed25 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.409975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c9a1c-bd44-47f0-b58d-ed432f88e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.410589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c9a1c-bd44-47f0-b58d-ed432f88e24c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.410864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c9a1c-bd44-47f0-b58d-ed432f88e24c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.411137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4c9a1c-bd44-47f0-b58d-ed432f88e24c None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.411827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c9a1c-bd44-47f0-b58d-ed432f88e24c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:45.412126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c9a1c-bd44-47f0-b58d-ed432f88e24c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.413500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4c9a1c-bd44-47f0-b58d-ed432f88e24c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.415378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.427183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 133/259] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:45.434229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6d046-2e40-4846-9bfb-749c8803a555 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.590462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6d046-2e40-4846-9bfb-749c8803a555 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.633296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01910df3-87ef-472b-9661-128fccd7907c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.633859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910df3-87ef-472b-9661-128fccd7907c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.634143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910df3-87ef-472b-9661-128fccd7907c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.634423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01910df3-87ef-472b-9661-128fccd7907c None admin] PATH_INFO: `/v3/users/833935b257834a959891ab304a757a4e` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.640290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01910df3-87ef-472b-9661-128fccd7907c None admin] RBAC: Authorizing `identity:get_user(user_id=833935b257834a959891ab304a757a4e)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.641742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01910df3-87ef-472b-9661-128fccd7907c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.643717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 127/260] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/users/833935b257834a959891ab304a757a4e => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:45.646805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c9a1c-bd44-47f0-b58d-ed432f88e24c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.649065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01910df3-87ef-472b-9661-128fccd7907c None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:45.697000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.818322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01910df3-87ef-472b-9661-128fccd7907c None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.821596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4c9a1c-bd44-47f0-b58d-ed432f88e24c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:45.857254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4d9f9-8456-4279-ae07-201c557d9588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.857873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4d9f9-8456-4279-ae07-201c557d9588 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.858150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4d9f9-8456-4279-ae07-201c557d9588 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.858542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc4d9f9-8456-4279-ae07-201c557d9588 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.905236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9bcb-ef3a-4173-98a5-fc4d759916b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:45.905804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9bcb-ef3a-4173-98a5-fc4d759916b5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:45.906086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9bcb-ef3a-4173-98a5-fc4d759916b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:45.906362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ee9bcb-ef3a-4173-98a5-fc4d759916b5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:45.938458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ee9bcb-ef3a-4173-98a5-fc4d759916b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:45.939225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4d9f9-8456-4279-ae07-201c557d9588 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:45.940746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc4d9f9-8456-4279-ae07-201c557d9588 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-55ee9bcb-ef3a-4173-98a5-fc4d759916b5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:45.943363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:45.944258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:45.946945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 134/261] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:45.961848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:45.968544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9bcb-ef3a-4173-98a5-fc4d759916b5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.054277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 128/262] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:46.063595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4d9f9-8456-4279-ae07-201c557d9588 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.116573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.170323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc4d9f9-8456-4279-ae07-201c557d9588 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.185179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.207053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf2987-d4b7-4601-8fab-2f22279f779a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.207952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf2987-d4b7-4601-8fab-2f22279f779a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.208557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf2987-d4b7-4601-8fab-2f22279f779a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.209006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf2987-d4b7-4601-8fab-2f22279f779a None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.210286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf2987-d4b7-4601-8fab-2f22279f779a None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.212705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf2987-d4b7-4601-8fab-2f22279f779a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.214795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 129/263] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:46.223187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf2987-d4b7-4601-8fab-2f22279f779a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.226908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ee9bcb-ef3a-4173-98a5-fc4d759916b5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.326672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d8e79-37f9-42e1-9570-d2e36313e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.327614 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d8e79-37f9-42e1-9570-d2e36313e688 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.328039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d8e79-37f9-42e1-9570-d2e36313e688 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.328454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d8e79-37f9-42e1-9570-d2e36313e688 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.329281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d8e79-37f9-42e1-9570-d2e36313e688 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:46.329726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d8e79-37f9-42e1-9570-d2e36313e688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.331237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d8e79-37f9-42e1-9570-d2e36313e688 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.355948 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 135/264] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:46.373279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d8e79-37f9-42e1-9570-d2e36313e688 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.447525 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf2987-d4b7-4601-8fab-2f22279f779a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.519851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5b7fc-b1a7-45a7-bb36-f6b7b337e2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.522149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5b7fc-b1a7-45a7-bb36-f6b7b337e2f2 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.522770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5b7fc-b1a7-45a7-bb36-f6b7b337e2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.524735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5b7fc-b1a7-45a7-bb36-f6b7b337e2f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.525647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5b7fc-b1a7-45a7-bb36-f6b7b337e2f2 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=d99f908d7e3746a5a68fca96958c366c, user.id=833935b257834a959891ab304a757a4e) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:46.526101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5b7fc-b1a7-45a7-bb36-f6b7b337e2f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.528608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5b7fc-b1a7-45a7-bb36-f6b7b337e2f2 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.543790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 130/265] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/role_assignments?user.id=833935b257834a959891ab304a757a4e&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 608 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:46.566829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d8e79-37f9-42e1-9570-d2e36313e688 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.589832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.616956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876762af-4191-4794-b927-4eb924620523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.617646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876762af-4191-4794-b927-4eb924620523 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.617931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876762af-4191-4794-b927-4eb924620523 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.618216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876762af-4191-4794-b927-4eb924620523 None admin] PATH_INFO: `/v3/users/833935b257834a959891ab304a757a4e` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.619542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876762af-4191-4794-b927-4eb924620523 None admin] RBAC: Authorizing `identity:get_user(user_id=833935b257834a959891ab304a757a4e)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.624934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876762af-4191-4794-b927-4eb924620523 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.626859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 136/266] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/users/833935b257834a959891ab304a757a4e => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:46.632511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5b7fc-b1a7-45a7-bb36-f6b7b337e2f2 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:46.701859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.762090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5b7fc-b1a7-45a7-bb36-f6b7b337e2f2 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:46.798957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edeeff-4630-4dd8-8b4b-d8e1987d027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:46.799604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edeeff-4630-4dd8-8b4b-d8e1987d027c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:46.799895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edeeff-4630-4dd8-8b4b-d8e1987d027c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:46.800173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03edeeff-4630-4dd8-8b4b-d8e1987d027c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:46.877514 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edeeff-4630-4dd8-8b4b-d8e1987d027c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:46.879136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03edeeff-4630-4dd8-8b4b-d8e1987d027c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:46.932525 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:46.998357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 131/267] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:46.999646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876762af-4191-4794-b927-4eb924620523 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:47.121997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876762af-4191-4794-b927-4eb924620523 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:47.164816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63771ac6-9368-4bf2-984d-f304bfc22f8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:47.165516 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63771ac6-9368-4bf2-984d-f304bfc22f8f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.165801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63771ac6-9368-4bf2-984d-f304bfc22f8f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.166075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63771ac6-9368-4bf2-984d-f304bfc22f8f None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.167202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63771ac6-9368-4bf2-984d-f304bfc22f8f None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:47.168681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63771ac6-9368-4bf2-984d-f304bfc22f8f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:47.170304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 137/268] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:46 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:47.176307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edeeff-4630-4dd8-8b4b-d8e1987d027c None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:47.262888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4080c73-416b-4593-925a-03392b1d6150 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.263195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4080c73-416b-4593-925a-03392b1d6150 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.263351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4080c73-416b-4593-925a-03392b1d6150 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.264833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 138/269] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:47.270016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243bc0-d737-42c2-8a93-3497926658f8 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.270301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243bc0-d737-42c2-8a93-3497926658f8 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.270575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d243bc0-d737-42c2-8a93-3497926658f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.295090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03edeeff-4630-4dd8-8b4b-d8e1987d027c None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:47.317304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-4d243bc0-d737-42c2-8a93-3497926658f8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:47.318899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4d243bc0-d737-42c2-8a93-3497926658f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:47.339005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad90c69-4cea-4bbd-aaf7-126080ecd6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:47.339974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad90c69-4cea-4bbd-aaf7-126080ecd6be None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.340399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad90c69-4cea-4bbd-aaf7-126080ecd6be None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.340797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad90c69-4cea-4bbd-aaf7-126080ecd6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.341709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad90c69-4cea-4bbd-aaf7-126080ecd6be None admin] RBAC: Adding query filter params (role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=d99f908d7e3746a5a68fca96958c366c, user.id=833935b257834a959891ab304a757a4e) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:47.342181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad90c69-4cea-4bbd-aaf7-126080ecd6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:47.343908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad90c69-4cea-4bbd-aaf7-126080ecd6be None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:47.355746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 132/270] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:47 2022] GET /identity/v3/role_assignments?user.id=833935b257834a959891ab304a757a4e&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:47.438539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:47.466906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 139/271] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:47.472539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95e777-aa4d-4ffb-a393-7540076c3a2b None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.473050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95e777-aa4d-4ffb-a393-7540076c3a2b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.473138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95e777-aa4d-4ffb-a393-7540076c3a2b None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.474697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 133/272] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:47.480639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846d57-1b67-457b-bfdf-17a3c36fc1d9 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.481487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846d57-1b67-457b-bfdf-17a3c36fc1d9 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.482181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66846d57-1b67-457b-bfdf-17a3c36fc1d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.484823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c574d4-6d1e-4c3d-abbe-7a35bcd74ce8 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.484953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c574d4-6d1e-4c3d-abbe-7a35bcd74ce8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.485216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c574d4-6d1e-4c3d-abbe-7a35bcd74ce8 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.487001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 134/273] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:47.493076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c3660-7be1-4f7b-80d5-b7e1bb14ab64 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.493352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c3660-7be1-4f7b-80d5-b7e1bb14ab64 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.493783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1c3660-7be1-4f7b-80d5-b7e1bb14ab64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.507042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-66846d57-1b67-457b-bfdf-17a3c36fc1d9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:47.509486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-66846d57-1b67-457b-bfdf-17a3c36fc1d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:47.528588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-fd1c3660-7be1-4f7b-80d5-b7e1bb14ab64 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:47.529738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fd1c3660-7be1-4f7b-80d5-b7e1bb14ab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:47.539846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:47.623163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 140/274] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:47.627541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 135/275] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:47.777033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66846d57-1b67-457b-bfdf-17a3c36fc1d9 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:47.883923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66846d57-1b67-457b-bfdf-17a3c36fc1d9 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:47.899937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:47.918030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c3660-7be1-4f7b-80d5-b7e1bb14ab64 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:47.927975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84571fc1-fd81-4dbf-bb9f-9fd0585024bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:47.928893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84571fc1-fd81-4dbf-bb9f-9fd0585024bb None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:47.929350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84571fc1-fd81-4dbf-bb9f-9fd0585024bb None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:47.930312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84571fc1-fd81-4dbf-bb9f-9fd0585024bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:47.944712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84571fc1-fd81-4dbf-bb9f-9fd0585024bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-84571fc1-fd81-4dbf-bb9f-9fd0585024bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:47.950462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:47.951366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:47.952210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 141/276] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:47.952929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84571fc1-fd81-4dbf-bb9f-9fd0585024bb None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.040668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1c3660-7be1-4f7b-80d5-b7e1bb14ab64 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.059384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84571fc1-fd81-4dbf-bb9f-9fd0585024bb None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.074604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50cce3-bcc1-46dd-b16c-2a5cfedf623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.075233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50cce3-bcc1-46dd-b16c-2a5cfedf623a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.075527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50cce3-bcc1-46dd-b16c-2a5cfedf623a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.075808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa50cce3-bcc1-46dd-b16c-2a5cfedf623a None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.076905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50cce3-bcc1-46dd-b16c-2a5cfedf623a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:48.078326 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa50cce3-bcc1-46dd-b16c-2a5cfedf623a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:48.079915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 136/277] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:48.083988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50cce3-bcc1-46dd-b16c-2a5cfedf623a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.092466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e003c2a4-b334-46f1-9032-f7a2872ed9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.093090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c2a4-b334-46f1-9032-f7a2872ed9e6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.093371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c2a4-b334-46f1-9032-f7a2872ed9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.093644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e003c2a4-b334-46f1-9032-f7a2872ed9e6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.094421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:48.103920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e003c2a4-b334-46f1-9032-f7a2872ed9e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-e003c2a4-b334-46f1-9032-f7a2872ed9e6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:48.108775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:48.109637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:48.110416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 142/278] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:48.111069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c879-65bc-4338-89f3-4993376482db None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.111293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c879-65bc-4338-89f3-4993376482db None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.111595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351c879-65bc-4338-89f3-4993376482db None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.112772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 143/279] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:48.113460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351c879-65bc-4338-89f3-4993376482db None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.148079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:48.187880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa50cce3-bcc1-46dd-b16c-2a5cfedf623a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.212945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351c879-65bc-4338-89f3-4993376482db None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.220853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe760c-8f48-4d8f-b740-8ab0769ac7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.221457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe760c-8f48-4d8f-b740-8ab0769ac7c0 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.221739 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe760c-8f48-4d8f-b740-8ab0769ac7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.222013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe760c-8f48-4d8f-b740-8ab0769ac7c0 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.222683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe760c-8f48-4d8f-b740-8ab0769ac7c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:48.222985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe760c-8f48-4d8f-b740-8ab0769ac7c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:48.224385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe760c-8f48-4d8f-b740-8ab0769ac7c0 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:48.233154 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 137/280] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:48.233877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe760c-8f48-4d8f-b740-8ab0769ac7c0 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.249191 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000266c-5107-4f84-a8a6-43a54f1a94ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.249795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000266c-5107-4f84-a8a6-43a54f1a94ec None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.250075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000266c-5107-4f84-a8a6-43a54f1a94ec None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.250347 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000266c-5107-4f84-a8a6-43a54f1a94ec None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.251001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000266c-5107-4f84-a8a6-43a54f1a94ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:48.252470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000266c-5107-4f84-a8a6-43a54f1a94ec None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:48.305145 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:48.326357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 144/281] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:32:48 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:48.327408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2174d4-baa9-4534-a720-b786ae48ccd2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.327724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2174d4-baa9-4534-a720-b786ae48ccd2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.328140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2174d4-baa9-4534-a720-b786ae48ccd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.335088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe760c-8f48-4d8f-b740-8ab0769ac7c0 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.356980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8e2174d4-baa9-4534-a720-b786ae48ccd2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:48.358296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8e2174d4-baa9-4534-a720-b786ae48ccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:48.376587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9308a-87d5-41bb-8cac-af242ca7f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.377212 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9308a-87d5-41bb-8cac-af242ca7f70f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.377497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9308a-87d5-41bb-8cac-af242ca7f70f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.377777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9308a-87d5-41bb-8cac-af242ca7f70f None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.378474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9308a-87d5-41bb-8cac-af242ca7f70f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:48.378776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9308a-87d5-41bb-8cac-af242ca7f70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:48.380231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9308a-87d5-41bb-8cac-af242ca7f70f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:48.391644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 138/282] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:48.391644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9308a-87d5-41bb-8cac-af242ca7f70f None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.440690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 145/283] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:48.452545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2174d4-baa9-4534-a720-b786ae48ccd2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.477263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:48.514701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9308a-87d5-41bb-8cac-af242ca7f70f None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.554797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:48.562042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c61991-94bc-40d8-b6b5-e67b556bc127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.562793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c61991-94bc-40d8-b6b5-e67b556bc127 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.563072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c61991-94bc-40d8-b6b5-e67b556bc127 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.563741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c61991-94bc-40d8-b6b5-e67b556bc127 None admin] PATH_INFO: `/v3/users/f9be4cdb9dc44890ba9e28fcd2c0c555` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.577094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2174d4-baa9-4534-a720-b786ae48ccd2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.582608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c61991-94bc-40d8-b6b5-e67b556bc127 None admin] RBAC: Authorizing `identity:get_user(user_id=f9be4cdb9dc44890ba9e28fcd2c0c555)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:48.584106 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c61991-94bc-40d8-b6b5-e67b556bc127 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:48.586683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 139/284] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:48 2022] GET /identity/v3/users/f9be4cdb9dc44890ba9e28fcd2c0c555 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:48.592357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c61991-94bc-40d8-b6b5-e67b556bc127 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.617703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65116e91-9049-4f35-843d-d258f4ef5a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.618334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65116e91-9049-4f35-843d-d258f4ef5a58 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.618615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65116e91-9049-4f35-843d-d258f4ef5a58 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.618886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65116e91-9049-4f35-843d-d258f4ef5a58 None admin] PATH_INFO: `/v3/users/0f78afa1888b4761b0886af4c9002bb0` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.621852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65116e91-9049-4f35-843d-d258f4ef5a58 None admin] RBAC: Authorizing `identity:get_user(user_id=0f78afa1888b4761b0886af4c9002bb0)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:48.623582 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65116e91-9049-4f35-843d-d258f4ef5a58 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:48.629990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 146/285] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:48 2022] GET /identity/v3/users/0f78afa1888b4761b0886af4c9002bb0 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:48.631421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65116e91-9049-4f35-843d-d258f4ef5a58 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.712578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c61991-94bc-40d8-b6b5-e67b556bc127 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.743906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:48.756619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921a441-83ca-4ce2-b11d-0bcb09f3b6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.757461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921a441-83ca-4ce2-b11d-0bcb09f3b6e6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.761225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921a441-83ca-4ce2-b11d-0bcb09f3b6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.761225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921a441-83ca-4ce2-b11d-0bcb09f3b6e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.761225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921a441-83ca-4ce2-b11d-0bcb09f3b6e6 None admin] RBAC: Adding query filter params (role.id=6fb126c9acf74dc9812a7bbcd5b196db, user.id=f9be4cdb9dc44890ba9e28fcd2c0c555, scope.system=all) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:48.761225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921a441-83ca-4ce2-b11d-0bcb09f3b6e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:48.761491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65116e91-9049-4f35-843d-d258f4ef5a58 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:48.761578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6921a441-83ca-4ce2-b11d-0bcb09f3b6e6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:48.767332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 140/286] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 4 08:32:48 2022] GET /identity/v3/role_assignments?user.id=f9be4cdb9dc44890ba9e28fcd2c0c555&scope.system=all&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:48.768264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921a441-83ca-4ce2-b11d-0bcb09f3b6e6 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.837244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9180601-49d2-4079-b091-51f06047e543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:48.837898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9180601-49d2-4079-b091-51f06047e543 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:48.838182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9180601-49d2-4079-b091-51f06047e543 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:48.838460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9180601-49d2-4079-b091-51f06047e543 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:48.839828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9180601-49d2-4079-b091-51f06047e543 None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:48.842606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9180601-49d2-4079-b091-51f06047e543 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:48.846652 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 147/287] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:48 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:48.855032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9180601-49d2-4079-b091-51f06047e543 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:48.859811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:48.955392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921a441-83ca-4ce2-b11d-0bcb09f3b6e6 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.001526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eafd1-f021-47b8-adbf-47bc776670ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.002092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eafd1-f021-47b8-adbf-47bc776670ce None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.002377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eafd1-f021-47b8-adbf-47bc776670ce None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.002654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eafd1-f021-47b8-adbf-47bc776670ce None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.016125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7eafd1-f021-47b8-adbf-47bc776670ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-ad7eafd1-f021-47b8-adbf-47bc776670ce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:49.022394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:49.023860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:49.024653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:49.026026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 141/288] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:49.034484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eafd1-f021-47b8-adbf-47bc776670ce None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.051280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9180601-49d2-4079-b091-51f06047e543 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.118213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0e5b0-73e1-4b62-a4ee-01752b221448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.119124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0e5b0-73e1-4b62-a4ee-01752b221448 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.119673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0e5b0-73e1-4b62-a4ee-01752b221448 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.120087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0e5b0-73e1-4b62-a4ee-01752b221448 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c/users/0f78afa1888b4761b0886af4c9002bb0/roles/43b28df8274a4b678cfbbb3d8eac0f52` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.123596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0e5b0-73e1-4b62-a4ee-01752b221448 None admin] RBAC: Authorizing `identity:create_grant(project_id=d99f908d7e3746a5a68fca96958c366c, user_id=0f78afa1888b4761b0886af4c9002bb0, role_id=43b28df8274a4b678cfbbb3d8eac0f52)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.125419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0e5b0-73e1-4b62-a4ee-01752b221448 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.187815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7eafd1-f021-47b8-adbf-47bc776670ce None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.206062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 148/289] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:32:48 2022] PUT /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c/users/0f78afa1888b4761b0886af4c9002bb0/roles/43b28df8274a4b678cfbbb3d8eac0f52 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:32:49.210273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.234299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5ace-2683-46b3-83b5-9dde60d06a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.235218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5ace-2683-46b3-83b5-9dde60d06a06 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.235667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5ace-2683-46b3-83b5-9dde60d06a06 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.236105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f5ace-2683-46b3-83b5-9dde60d06a06 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.236986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5ace-2683-46b3-83b5-9dde60d06a06 None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:49.237589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5ace-2683-46b3-83b5-9dde60d06a06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.239314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f5ace-2683-46b3-83b5-9dde60d06a06 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.249601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 142/290] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:49.255884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0e5b0-73e1-4b62-a4ee-01752b221448 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.278614 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.418934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0e5b0-73e1-4b62-a4ee-01752b221448 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.456899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e96c0-e283-4f68-999a-8fa3a9bb52a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.457537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e96c0-e283-4f68-999a-8fa3a9bb52a6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.457821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e96c0-e283-4f68-999a-8fa3a9bb52a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.458098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979e96c0-e283-4f68-999a-8fa3a9bb52a6 None admin] PATH_INFO: `/v3/users/4ad21fcd84cc4e61a0d7e729feecf90d` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.459247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e96c0-e283-4f68-999a-8fa3a9bb52a6 None admin] RBAC: Authorizing `identity:get_user(user_id=4ad21fcd84cc4e61a0d7e729feecf90d)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.461261 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979e96c0-e283-4f68-999a-8fa3a9bb52a6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.463152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 149/291] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/users/4ad21fcd84cc4e61a0d7e729feecf90d => generated 297 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:49.468794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5ace-2683-46b3-83b5-9dde60d06a06 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:49.589241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f5ace-2683-46b3-83b5-9dde60d06a06 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:49.632474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b69ad-91d7-458f-8a90-b04a8c62ac9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:49.633652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b69ad-91d7-458f-8a90-b04a8c62ac9d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:49.633977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b69ad-91d7-458f-8a90-b04a8c62ac9d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:49.634192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b69ad-91d7-458f-8a90-b04a8c62ac9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:49.696918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:49.719789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b69ad-91d7-458f-8a90-b04a8c62ac9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:49.721247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b69ad-91d7-458f-8a90-b04a8c62ac9d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:49.924771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 143/292] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:49.930788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e96c0-e283-4f68-999a-8fa3a9bb52a6 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.057925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:50.077881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979e96c0-e283-4f68-999a-8fa3a9bb52a6 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.121555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b229ef0d-7ebf-4fcd-a44a-e0bcfe4027f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.122188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229ef0d-7ebf-4fcd-a44a-e0bcfe4027f0 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.122469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229ef0d-7ebf-4fcd-a44a-e0bcfe4027f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.122743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b229ef0d-7ebf-4fcd-a44a-e0bcfe4027f0 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.123905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229ef0d-7ebf-4fcd-a44a-e0bcfe4027f0 None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.125350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b229ef0d-7ebf-4fcd-a44a-e0bcfe4027f0 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.127330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 150/293] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:49 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:50.133652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b69ad-91d7-458f-8a90-b04a8c62ac9d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:50.238441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:50.264959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b69ad-91d7-458f-8a90-b04a8c62ac9d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:50.308038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab50cb97-b595-4786-8dbd-d9cb4ca0701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:50.308659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50cb97-b595-4786-8dbd-d9cb4ca0701d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:50.308942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50cb97-b595-4786-8dbd-d9cb4ca0701d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:50.309221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab50cb97-b595-4786-8dbd-d9cb4ca0701d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:50.309968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50cb97-b595-4786-8dbd-d9cb4ca0701d None admin] RBAC: Adding query filter params (role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=d99f908d7e3746a5a68fca96958c366c, user.id=4ad21fcd84cc4e61a0d7e729feecf90d) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:50.310278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50cb97-b595-4786-8dbd-d9cb4ca0701d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:50.311736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab50cb97-b595-4786-8dbd-d9cb4ca0701d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:50.318386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 144/294] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:50 2022] GET /identity/v3/role_assignments?user.id=4ad21fcd84cc4e61a0d7e729feecf90d&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:51.064062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f6b6-7d30-4488-a6ec-289bed086018 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.064565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f6b6-7d30-4488-a6ec-289bed086018 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.064641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad05f6b6-7d30-4488-a6ec-289bed086018 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.065993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 151/295] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:51.071470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595d2f-7d87-424d-8b2e-3eba4674f6c2 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.071914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595d2f-7d87-424d-8b2e-3eba4674f6c2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.072146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc595d2f-7d87-424d-8b2e-3eba4674f6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.090873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bc595d2f-7d87-424d-8b2e-3eba4674f6c2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:51.092111 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bc595d2f-7d87-424d-8b2e-3eba4674f6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:51.166015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 145/296] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:51.225799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bc8c4-e24e-4328-84de-4344b183993c None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.226133 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bc8c4-e24e-4328-84de-4344b183993c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.226386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4bc8c4-e24e-4328-84de-4344b183993c None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.227784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 152/297] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:51.233047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0feeb-cdcc-4927-ab0d-d7854976e5c2 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.233343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0feeb-cdcc-4927-ab0d-d7854976e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.233623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0feeb-cdcc-4927-ab0d-d7854976e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.253161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-93a0feeb-cdcc-4927-ab0d-d7854976e5c2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:51.254401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-93a0feeb-cdcc-4927-ab0d-d7854976e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:51.328097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:51.330492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 146/298] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:51.377418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c95b1-23f5-47c0-82f0-47961d5755df None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.377866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c95b1-23f5-47c0-82f0-47961d5755df None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.378147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c95b1-23f5-47c0-82f0-47961d5755df None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.379522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 153/299] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:51.385166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5b1f-4edf-4980-aee8-ce00515bf605 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.385458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5b1f-4edf-4980-aee8-ce00515bf605 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.385740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fb5b1f-4edf-4980-aee8-ce00515bf605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.404586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-75fb5b1f-4edf-4980-aee8-ce00515bf605 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:51.405836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-75fb5b1f-4edf-4980-aee8-ce00515bf605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:51.436277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c95b1-23f5-47c0-82f0-47961d5755df None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:51.474707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 147/300] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:51.548779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c95b1-23f5-47c0-82f0-47961d5755df None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:51.594742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0437-2ced-4f2f-a563-1f6b1fb90109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:51.595383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0437-2ced-4f2f-a563-1f6b1fb90109 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.595703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0437-2ced-4f2f-a563-1f6b1fb90109 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.595980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957f0437-2ced-4f2f-a563-1f6b1fb90109 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.597087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f0437-2ced-4f2f-a563-1f6b1fb90109 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:51.598641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957f0437-2ced-4f2f-a563-1f6b1fb90109 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:51.600682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 154/301] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:51.606595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5b1f-4edf-4980-aee8-ce00515bf605 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:51.612739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0437-2ced-4f2f-a563-1f6b1fb90109 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:51.640267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:51.724129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957f0437-2ced-4f2f-a563-1f6b1fb90109 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:51.729871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fb5b1f-4edf-4980-aee8-ce00515bf605 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:51.760079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b9935a-f61d-4425-9519-bde18b288c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:51.760605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:51.760713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9935a-f61d-4425-9519-bde18b288c68 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.760981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9935a-f61d-4425-9519-bde18b288c68 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.761256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b9935a-f61d-4425-9519-bde18b288c68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.766300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211e528-a28f-4454-8dd9-c3f3dc077fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:51.767000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211e528-a28f-4454-8dd9-c3f3dc077fbc None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.767221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211e528-a28f-4454-8dd9-c3f3dc077fbc None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.767497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3211e528-a28f-4454-8dd9-c3f3dc077fbc None admin] PATH_INFO: `/v3/groups` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.768173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211e528-a28f-4454-8dd9-c3f3dc077fbc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:51.773113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3211e528-a28f-4454-8dd9-c3f3dc077fbc None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:51.773213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b9935a-f61d-4425-9519-bde18b288c68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-77b9935a-f61d-4425-9519-bde18b288c68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:51.775974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:51.777030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:51.777836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 155/302] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:51.778490 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f94e7-532a-4bca-9088-ce0027239605 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.778490 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f94e7-532a-4bca-9088-ce0027239605 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.778754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0f94e7-532a-4bca-9088-ce0027239605 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.779975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 156/303] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:51.780671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f94e7-532a-4bca-9088-ce0027239605 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:51.859198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:51.865549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 148/304] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Oct 4 08:32:51 2022] POST /identity/v3/groups => generated 229 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:51.866390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211e528-a28f-4454-8dd9-c3f3dc077fbc None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:51.880214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0f94e7-532a-4bca-9088-ce0027239605 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:51.918619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c79f1e-1ecf-436a-aa6d-08ab1c29e9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:51.919274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c79f1e-1ecf-436a-aa6d-08ab1c29e9a2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.919591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c79f1e-1ecf-436a-aa6d-08ab1c29e9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.919872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c79f1e-1ecf-436a-aa6d-08ab1c29e9a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.933464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c79f1e-1ecf-436a-aa6d-08ab1c29e9a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-26c79f1e-1ecf-436a-aa6d-08ab1c29e9a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:51.938866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:51.939877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:51.940756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 157/305] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:51.941455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055fca9-352a-4394-aa16-608c425cde49 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:51.942242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055fca9-352a-4394-aa16-608c425cde49 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:51.942242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055fca9-352a-4394-aa16-608c425cde49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:51.963725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-0055fca9-352a-4394-aa16-608c425cde49 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:51.965064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0055fca9-352a-4394-aa16-608c425cde49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:51.998385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3211e528-a28f-4454-8dd9-c3f3dc077fbc None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.037005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 158/306] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:52.043865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055fca9-352a-4394-aa16-608c425cde49 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.048094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e8bc-9d97-46e5-8321-79bfd1c3f3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.048719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e8bc-9d97-46e5-8321-79bfd1c3f3cd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.049000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e8bc-9d97-46e5-8321-79bfd1c3f3cd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.049277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8e8bc-9d97-46e5-8321-79bfd1c3f3cd None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.049957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e8bc-9d97-46e5-8321-79bfd1c3f3cd None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:52.050261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e8bc-9d97-46e5-8321-79bfd1c3f3cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:52.051752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a8e8bc-9d97-46e5-8321-79bfd1c3f3cd None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:52.061413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 149/307] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:52.066848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e8bc-9d97-46e5-8321-79bfd1c3f3cd None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.127374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:52.141249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:52.167552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055fca9-352a-4394-aa16-608c425cde49 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.192607 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8e8bc-9d97-46e5-8321-79bfd1c3f3cd None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.213486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9582-8b34-4887-b71b-0738ab169a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.214325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9582-8b34-4887-b71b-0738ab169a86 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.214752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9582-8b34-4887-b71b-0738ab169a86 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.215169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eac9582-8b34-4887-b71b-0738ab169a86 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.216136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9582-8b34-4887-b71b-0738ab169a86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:52.216817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9582-8b34-4887-b71b-0738ab169a86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:52.219331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eac9582-8b34-4887-b71b-0738ab169a86 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:52.228715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 159/308] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:52.234768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9582-8b34-4887-b71b-0738ab169a86 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.236566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b749100-9f14-4cdc-92d3-52064ab5ee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.237198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b749100-9f14-4cdc-92d3-52064ab5ee05 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.237473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b749100-9f14-4cdc-92d3-52064ab5ee05 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.237745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b749100-9f14-4cdc-92d3-52064ab5ee05 None admin] PATH_INFO: `/v3/users/f9be4cdb9dc44890ba9e28fcd2c0c555` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.239168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b749100-9f14-4cdc-92d3-52064ab5ee05 None admin] RBAC: Authorizing `identity:get_user(user_id=f9be4cdb9dc44890ba9e28fcd2c0c555)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:52.241655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b749100-9f14-4cdc-92d3-52064ab5ee05 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:52.244245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 150/309] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/users/f9be4cdb9dc44890ba9e28fcd2c0c555 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:52.249609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b749100-9f14-4cdc-92d3-52064ab5ee05 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.359050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b749100-9f14-4cdc-92d3-52064ab5ee05 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.371099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eac9582-8b34-4887-b71b-0738ab169a86 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.378380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:52.392286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1418b8-c75b-4803-b063-bace222dd23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.392935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1418b8-c75b-4803-b063-bace222dd23d None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.393213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1418b8-c75b-4803-b063-bace222dd23d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.393483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1418b8-c75b-4803-b063-bace222dd23d None admin] PATH_INFO: `/v3/system/users/f9be4cdb9dc44890ba9e28fcd2c0c555/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.395494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1418b8-c75b-4803-b063-bace222dd23d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f9be4cdb9dc44890ba9e28fcd2c0c555, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:52.396880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1418b8-c75b-4803-b063-bace222dd23d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:52.405003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:52.409706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3a9b0-e60b-441b-8c12-a7706e281eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.410329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3a9b0-e60b-441b-8c12-a7706e281eb5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.410605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3a9b0-e60b-441b-8c12-a7706e281eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.410871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3a9b0-e60b-441b-8c12-a7706e281eb5 None admin] PATH_INFO: `/v3/users/97f074af413f4afca39c2c16d28329c4` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.424752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3a9b0-e60b-441b-8c12-a7706e281eb5 None admin] RBAC: Authorizing `identity:get_user(user_id=97f074af413f4afca39c2c16d28329c4)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:52.426254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3a9b0-e60b-441b-8c12-a7706e281eb5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:52.428165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 160/310] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/users/97f074af413f4afca39c2c16d28329c4 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:52.433060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3a9b0-e60b-441b-8c12-a7706e281eb5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.478661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 151/311] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Oct 4 08:32:52 2022] PUT /identity/v3/system/users/f9be4cdb9dc44890ba9e28fcd2c0c555/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:32:52.487899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1418b8-c75b-4803-b063-bace222dd23d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.558693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3a9b0-e60b-441b-8c12-a7706e281eb5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.615061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba40d2-4878-493b-9a8d-21457c43da84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.616259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba40d2-4878-493b-9a8d-21457c43da84 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.616575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba40d2-4878-493b-9a8d-21457c43da84 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.616851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba40d2-4878-493b-9a8d-21457c43da84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.628377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1418b8-c75b-4803-b063-bace222dd23d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.636020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba40d2-4878-493b-9a8d-21457c43da84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-00ba40d2-4878-493b-9a8d-21457c43da84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:52.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:52.643813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:52.644752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 161/312] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:52.650271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba40d2-4878-493b-9a8d-21457c43da84 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.687187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0e324-0467-4a3c-955c-11254d16ce6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.688002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0e324-0467-4a3c-955c-11254d16ce6b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.688372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0e324-0467-4a3c-955c-11254d16ce6b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.688737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0e324-0467-4a3c-955c-11254d16ce6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.689528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0e324-0467-4a3c-955c-11254d16ce6b None admin] RBAC: Adding query filter params (role.id=43b28df8274a4b678cfbbb3d8eac0f52, user.id=97f074af413f4afca39c2c16d28329c4, scope.system=all) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:52.689901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0e324-0467-4a3c-955c-11254d16ce6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:52.693031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0e324-0467-4a3c-955c-11254d16ce6b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:52.701629 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 152/313] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/role_assignments?user.id=97f074af413f4afca39c2c16d28329c4&scope.system=all&role.id=43b28df8274a4b678cfbbb3d8eac0f52 => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:52.719930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:52.774531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba40d2-4878-493b-9a8d-21457c43da84 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.812947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5abcf-e7b6-42bc-b701-455374169a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.813904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5abcf-e7b6-42bc-b701-455374169a2f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.814343 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5abcf-e7b6-42bc-b701-455374169a2f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.814774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5abcf-e7b6-42bc-b701-455374169a2f None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.815649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5abcf-e7b6-42bc-b701-455374169a2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:52.816131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5abcf-e7b6-42bc-b701-455374169a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:52.817690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5abcf-e7b6-42bc-b701-455374169a2f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:52.828441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 162/314] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:52.835937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0e324-0467-4a3c-955c-11254d16ce6b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:52.889517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:52.942797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0e324-0467-4a3c-955c-11254d16ce6b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:52.978952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73689ab7-e975-4917-8271-8e9708168a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:52.979613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73689ab7-e975-4917-8271-8e9708168a6d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:52.979899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73689ab7-e975-4917-8271-8e9708168a6d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:52.980171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73689ab7-e975-4917-8271-8e9708168a6d None admin] PATH_INFO: `/v3/users/0f78afa1888b4761b0886af4c9002bb0` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:52.981307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73689ab7-e975-4917-8271-8e9708168a6d None admin] RBAC: Authorizing `identity:get_user(user_id=0f78afa1888b4761b0886af4c9002bb0)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:52.982727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73689ab7-e975-4917-8271-8e9708168a6d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:52.984772 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 153/315] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/users/0f78afa1888b4761b0886af4c9002bb0 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:52.990259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5abcf-e7b6-42bc-b701-455374169a2f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:53.099369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5abcf-e7b6-42bc-b701-455374169a2f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:53.115538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:53.136756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb4782-2867-46cd-8e8d-ac68d86ccbf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:53.136756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4782-2867-46cd-8e8d-ac68d86ccbf3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.136756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4782-2867-46cd-8e8d-ac68d86ccbf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.136756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb4782-2867-46cd-8e8d-ac68d86ccbf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.210681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb4782-2867-46cd-8e8d-ac68d86ccbf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:53.212182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddb4782-2867-46cd-8e8d-ac68d86ccbf3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:53.316921 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 163/316] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:53.323667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73689ab7-e975-4917-8271-8e9708168a6d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:53.433841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73689ab7-e975-4917-8271-8e9708168a6d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:53.449977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:53.474515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46896041-7d55-4404-a2a8-59e3bfede08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:53.474515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896041-7d55-4404-a2a8-59e3bfede08f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.474515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896041-7d55-4404-a2a8-59e3bfede08f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.474515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46896041-7d55-4404-a2a8-59e3bfede08f None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.474957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46896041-7d55-4404-a2a8-59e3bfede08f None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:53.474957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46896041-7d55-4404-a2a8-59e3bfede08f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:53.474957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 154/317] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:53 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:53.479813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb4782-2867-46cd-8e8d-ac68d86ccbf3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:53.496575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:53.584334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb4782-2867-46cd-8e8d-ac68d86ccbf3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:53.619815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25ef707-e356-4983-bed7-fc1715c5c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:53.620421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef707-e356-4983-bed7-fc1715c5c69d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:53.620699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef707-e356-4983-bed7-fc1715c5c69d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:53.620971 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25ef707-e356-4983-bed7-fc1715c5c69d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:53.621699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef707-e356-4983-bed7-fc1715c5c69d None admin] RBAC: Adding query filter params (role.id=43b28df8274a4b678cfbbb3d8eac0f52, scope.project.id=d99f908d7e3746a5a68fca96958c366c, user.id=0f78afa1888b4761b0886af4c9002bb0) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:53.622005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef707-e356-4983-bed7-fc1715c5c69d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:53.623447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25ef707-e356-4983-bed7-fc1715c5c69d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:53.630718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 164/318] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:32:53 2022] GET /identity/v3/role_assignments?user.id=0f78afa1888b4761b0886af4c9002bb0&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=43b28df8274a4b678cfbbb3d8eac0f52 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:54.150449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe066-0527-45f1-8a52-f555c581e61c None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.150818 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe066-0527-45f1-8a52-f555c581e61c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.151012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833fe066-0527-45f1-8a52-f555c581e61c None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.152398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 155/319] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:54.157418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1ff3-4d28-4790-b6d0-cf8f9829f14d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.157858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1ff3-4d28-4790-b6d0-cf8f9829f14d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.158012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6d1ff3-4d28-4790-b6d0-cf8f9829f14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.176137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-3d6d1ff3-4d28-4790-b6d0-cf8f9829f14d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:54.177545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3d6d1ff3-4d28-4790-b6d0-cf8f9829f14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:54.241851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 165/320] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:54.508749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe066-0527-45f1-8a52-f555c581e61c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.615055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833fe066-0527-45f1-8a52-f555c581e61c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.648649 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb67f36d-817d-4dd4-8639-4a53948d0128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.649280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67f36d-817d-4dd4-8639-4a53948d0128 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.649555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67f36d-817d-4dd4-8639-4a53948d0128 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.649821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb67f36d-817d-4dd4-8639-4a53948d0128 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.650914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67f36d-817d-4dd4-8639-4a53948d0128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:54.652356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb67f36d-817d-4dd4-8639-4a53948d0128 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:54.654064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 156/321] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:32:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:54.659364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1ff3-4d28-4790-b6d0-cf8f9829f14d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:54.667458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:54.768096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6d1ff3-4d28-4790-b6d0-cf8f9829f14d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:54.800605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a043281d-7de3-40b8-8cb4-81553350d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:54.801214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043281d-7de3-40b8-8cb4-81553350d909 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.801503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043281d-7de3-40b8-8cb4-81553350d909 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.801845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a043281d-7de3-40b8-8cb4-81553350d909 None admin] PATH_INFO: `/v3/groups` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.802671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043281d-7de3-40b8-8cb4-81553350d909 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:54.804703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a043281d-7de3-40b8-8cb4-81553350d909 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:54.835927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0fc0-ac3d-4d1a-b339-57093875e47f None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.836213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0fc0-ac3d-4d1a-b339-57093875e47f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.836492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e0fc0-ac3d-4d1a-b339-57093875e47f None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.837862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 157/322] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:54.843623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42862e1d-6887-45e1-bf51-7fc2f2441743 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.843907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42862e1d-6887-45e1-bf51-7fc2f2441743 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.844207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42862e1d-6887-45e1-bf51-7fc2f2441743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.861996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-42862e1d-6887-45e1-bf51-7fc2f2441743 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:54.863160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-42862e1d-6887-45e1-bf51-7fc2f2441743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:54.878105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 166/323] 10.222.0.25 () {60 vars in 1134 bytes} [Tue Oct 4 08:32:54 2022] POST /identity/v3/groups => generated 226 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:32:54.918199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:54.934234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccbacf-7d34-4272-a63e-8f51bd8499c8 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.934643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccbacf-7d34-4272-a63e-8f51bd8499c8 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.934848 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ccbacf-7d34-4272-a63e-8f51bd8499c8 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.936632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 167/324] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:32:54.943552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 158/325] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:54.943740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caadd52-21e9-431f-b52e-f748711ff4c4 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:54.943740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caadd52-21e9-431f-b52e-f748711ff4c4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:54.943740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caadd52-21e9-431f-b52e-f748711ff4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:54.966859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-2caadd52-21e9-431f-b52e-f748711ff4c4 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:54.968153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2caadd52-21e9-431f-b52e-f748711ff4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:55.034980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.044450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 168/326] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:55.219579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42862e1d-6887-45e1-bf51-7fc2f2441743 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.317400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caadd52-21e9-431f-b52e-f748711ff4c4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.326262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42862e1d-6887-45e1-bf51-7fc2f2441743 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.363008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df273a-6c35-4061-8e35-88a47d2a7b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.363692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df273a-6c35-4061-8e35-88a47d2a7b55 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.363971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df273a-6c35-4061-8e35-88a47d2a7b55 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.364241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df273a-6c35-4061-8e35-88a47d2a7b55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.377118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df273a-6c35-4061-8e35-88a47d2a7b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-59df273a-6c35-4061-8e35-88a47d2a7b55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:55.383209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:55.384138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:55.384919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 159/327] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:55.392034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df273a-6c35-4061-8e35-88a47d2a7b55 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.442450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.486855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caadd52-21e9-431f-b52e-f748711ff4c4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.520180 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df273a-6c35-4061-8e35-88a47d2a7b55 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.555032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55e5a6-0cb0-4381-8042-f67656f5a9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.555851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55e5a6-0cb0-4381-8042-f67656f5a9aa None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.556547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55e5a6-0cb0-4381-8042-f67656f5a9aa None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.556834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea55e5a6-0cb0-4381-8042-f67656f5a9aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.565274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a50932-12fb-40ba-9ddc-0c39f2605d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.565881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a50932-12fb-40ba-9ddc-0c39f2605d92 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.566304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a50932-12fb-40ba-9ddc-0c39f2605d92 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.566598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a50932-12fb-40ba-9ddc-0c39f2605d92 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.567675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a50932-12fb-40ba-9ddc-0c39f2605d92 None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:55.567932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a50932-12fb-40ba-9ddc-0c39f2605d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.569997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a50932-12fb-40ba-9ddc-0c39f2605d92 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.572373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea55e5a6-0cb0-4381-8042-f67656f5a9aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-ea55e5a6-0cb0-4381-8042-f67656f5a9aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:55.578770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:55.579683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:55.580502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 169/329] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:55.581176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 160/329] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:55.585785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55e5a6-0cb0-4381-8042-f67656f5a9aa None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.587546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a50932-12fb-40ba-9ddc-0c39f2605d92 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.650417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.700219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea55e5a6-0cb0-4381-8042-f67656f5a9aa None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.708883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a50932-12fb-40ba-9ddc-0c39f2605d92 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.715575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.743697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09666a-e950-454e-98a4-cef517e88756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.744427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09666a-e950-454e-98a4-cef517e88756 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.744777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09666a-e950-454e-98a4-cef517e88756 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.745268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09666a-e950-454e-98a4-cef517e88756 None admin] PATH_INFO: `/v3/users/f9be4cdb9dc44890ba9e28fcd2c0c555` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.746992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09666a-e950-454e-98a4-cef517e88756 None admin] RBAC: Authorizing `identity:get_user(user_id=f9be4cdb9dc44890ba9e28fcd2c0c555)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.749189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b09666a-e950-454e-98a4-cef517e88756 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.751969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 170/330] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/users/f9be4cdb9dc44890ba9e28fcd2c0c555 => generated 293 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:55.754588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f18da-d05f-457c-805d-b406dcadbcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.755197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f18da-d05f-457c-805d-b406dcadbcd9 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.755471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f18da-d05f-457c-805d-b406dcadbcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.755765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f18da-d05f-457c-805d-b406dcadbcd9 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.756428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f18da-d05f-457c-805d-b406dcadbcd9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:55.756730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f18da-d05f-457c-805d-b406dcadbcd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.758112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09666a-e950-454e-98a4-cef517e88756 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.758630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7f18da-d05f-457c-805d-b406dcadbcd9 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.768649 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 161/331] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:55.775166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f18da-d05f-457c-805d-b406dcadbcd9 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:55.876126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09666a-e950-454e-98a4-cef517e88756 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.898403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7f18da-d05f-457c-805d-b406dcadbcd9 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:55.908645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:55.916263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81068-98a9-429f-88f7-bc3f6d50b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.917056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81068-98a9-429f-88f7-bc3f6d50b344 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.917393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81068-98a9-429f-88f7-bc3f6d50b344 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.917765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81068-98a9-429f-88f7-bc3f6d50b344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.918589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81068-98a9-429f-88f7-bc3f6d50b344 None admin] RBAC: Adding query filter params (role.id=6fb126c9acf74dc9812a7bbcd5b196db, user.id=f9be4cdb9dc44890ba9e28fcd2c0c555, scope.system=all) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:55.919108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81068-98a9-429f-88f7-bc3f6d50b344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.920866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81068-98a9-429f-88f7-bc3f6d50b344 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.936578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 171/332] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/role_assignments?user.id=f9be4cdb9dc44890ba9e28fcd2c0c555&scope.system=all&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:55.943879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84061abc-075b-41f3-845d-4c9b2b36e2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:55.945358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061abc-075b-41f3-845d-4c9b2b36e2ad None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:55.945808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061abc-075b-41f3-845d-4c9b2b36e2ad None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:55.946225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84061abc-075b-41f3-845d-4c9b2b36e2ad None admin] PATH_INFO: `/v3/users/97f074af413f4afca39c2c16d28329c4` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:55.947729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84061abc-075b-41f3-845d-4c9b2b36e2ad None admin] RBAC: Authorizing `identity:get_user(user_id=97f074af413f4afca39c2c16d28329c4)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:55.949391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84061abc-075b-41f3-845d-4c9b2b36e2ad None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:55.951881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 162/333] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:32:55 2022] GET /identity/v3/users/97f074af413f4afca39c2c16d28329c4 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:55.957599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81068-98a9-429f-88f7-bc3f6d50b344 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:56.070778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81068-98a9-429f-88f7-bc3f6d50b344 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:56.107026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6e3030-9087-407e-8338-0be1f6b9d27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:56.107719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e3030-9087-407e-8338-0be1f6b9d27f None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:56.107998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e3030-9087-407e-8338-0be1f6b9d27f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:56.108271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6e3030-9087-407e-8338-0be1f6b9d27f None admin] PATH_INFO: `/v3/system/users/97f074af413f4afca39c2c16d28329c4/roles/43b28df8274a4b678cfbbb3d8eac0f52` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:56.109795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e3030-9087-407e-8338-0be1f6b9d27f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=97f074af413f4afca39c2c16d28329c4, role_id=43b28df8274a4b678cfbbb3d8eac0f52)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:56.111317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6e3030-9087-407e-8338-0be1f6b9d27f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:56.187489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 172/334] 10.222.0.25 () {58 vars in 1334 bytes} [Tue Oct 4 08:32:55 2022] PUT /identity/v3/system/users/97f074af413f4afca39c2c16d28329c4/roles/43b28df8274a4b678cfbbb3d8eac0f52 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:32:57.690118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf79d-a21e-4cea-8d16-b2bb8ac27c73 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.691076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf79d-a21e-4cea-8d16-b2bb8ac27c73 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.691572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf79d-a21e-4cea-8d16-b2bb8ac27c73 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.693468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 163/335] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:57.699199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7013c01-a9c1-47dc-9dac-afdfc04ab70f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:57.700044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7013c01-a9c1-47dc-9dac-afdfc04ab70f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:57.700529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7013c01-a9c1-47dc-9dac-afdfc04ab70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:57.729945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f7013c01-a9c1-47dc-9dac-afdfc04ab70f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:57.731144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f7013c01-a9c1-47dc-9dac-afdfc04ab70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:57.784508 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:57.810485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 173/336] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:58.288072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf79d-a21e-4cea-8d16-b2bb8ac27c73 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.332845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:58.411289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf79d-a21e-4cea-8d16-b2bb8ac27c73 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.443746 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13dca-c6b2-4fc9-b69b-b38488a9414b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.444149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13dca-c6b2-4fc9-b69b-b38488a9414b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.444952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c13dca-c6b2-4fc9-b69b-b38488a9414b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.446668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 174/337] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:58.449023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabef0d-215f-48b2-9028-35000f7c4b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.449854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabef0d-215f-48b2-9028-35000f7c4b24 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.450289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabef0d-215f-48b2-9028-35000f7c4b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.450699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eabef0d-215f-48b2-9028-35000f7c4b24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.462564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eabef0d-215f-48b2-9028-35000f7c4b24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:58.466565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033806a9-0732-45bd-aced-6d835c06fbc4 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.466855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033806a9-0732-45bd-aced-6d835c06fbc4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.467136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033806a9-0732-45bd-aced-6d835c06fbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-6eabef0d-215f-48b2-9028-35000f7c4b24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:58.468411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:58.469432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:58.470399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:58.472594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 164/338] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:58.478309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabef0d-215f-48b2-9028-35000f7c4b24 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.497786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-033806a9-0732-45bd-aced-6d835c06fbc4 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:58.500604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-033806a9-0732-45bd-aced-6d835c06fbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:58.614929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 175/339] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:32:58.617063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697bc3-0025-4d1d-95c5-e274f25832f8 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.617542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697bc3-0025-4d1d-95c5-e274f25832f8 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.618088 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72697bc3-0025-4d1d-95c5-e274f25832f8 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.619793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 176/340] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:58.627105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170724be-79b2-4821-a768-644b86f96f9b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.628861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170724be-79b2-4821-a768-644b86f96f9b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.629277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170724be-79b2-4821-a768-644b86f96f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.656949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:58.664507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-170724be-79b2-4821-a768-644b86f96f9b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:58.666551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-170724be-79b2-4821-a768-644b86f96f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:58.670883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eabef0d-215f-48b2-9028-35000f7c4b24 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.733328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f394b-f122-4574-a1ad-a29d3ea27f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.734618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f394b-f122-4574-a1ad-a29d3ea27f41 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.735797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f394b-f122-4574-a1ad-a29d3ea27f41 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.736226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f394b-f122-4574-a1ad-a29d3ea27f41 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.738228 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f394b-f122-4574-a1ad-a29d3ea27f41 None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:58.738675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f394b-f122-4574-a1ad-a29d3ea27f41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:58.740995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1f394b-f122-4574-a1ad-a29d3ea27f41 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:58.762603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 165/341] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:58.776966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f394b-f122-4574-a1ad-a29d3ea27f41 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:58.791669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 177/342] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:58.909844 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f394b-f122-4574-a1ad-a29d3ea27f41 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:58.958767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142b20b-f4fc-481e-b3d1-af53ce9b7620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:58.959759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142b20b-f4fc-481e-b3d1-af53ce9b7620 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:58.960175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142b20b-f4fc-481e-b3d1-af53ce9b7620 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:58.960625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142b20b-f4fc-481e-b3d1-af53ce9b7620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:58.986875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.043138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142b20b-f4fc-481e-b3d1-af53ce9b7620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.044973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0142b20b-f4fc-481e-b3d1-af53ce9b7620 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.154314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 166/343] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:32:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:32:59.160259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170724be-79b2-4821-a768-644b86f96f9b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.199890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.242177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2fe14-d997-4e24-9fc1-8093ce82337c None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.242677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2fe14-d997-4e24-9fc1-8093ce82337c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.243114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b2fe14-d997-4e24-9fc1-8093ce82337c None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.244951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 167/344] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:59.249873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80531655-f75a-46c4-84e7-4062e53bbd9f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.250298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80531655-f75a-46c4-84e7-4062e53bbd9f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.250675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80531655-f75a-46c4-84e7-4062e53bbd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.277481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170724be-79b2-4821-a768-644b86f96f9b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.280722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-80531655-f75a-46c4-84e7-4062e53bbd9f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:32:59.281947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-80531655-f75a-46c4-84e7-4062e53bbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:32:59.318234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7070f-7207-4f90-88bc-e46ddb4daa73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.319169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7070f-7207-4f90-88bc-e46ddb4daa73 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.319667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7070f-7207-4f90-88bc-e46ddb4daa73 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.320076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7070f-7207-4f90-88bc-e46ddb4daa73 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.321374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7070f-7207-4f90-88bc-e46ddb4daa73 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.322956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7070f-7207-4f90-88bc-e46ddb4daa73 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.324849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 178/345] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:59.332628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7070f-7207-4f90-88bc-e46ddb4daa73 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.362176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.384557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 168/346] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:32:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:32:59.386046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80531655-f75a-46c4-84e7-4062e53bbd9f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.451060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7070f-7207-4f90-88bc-e46ddb4daa73 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.454731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.501515 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a58807-3669-4bd2-af89-2f5d4d12bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.502483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a58807-3669-4bd2-af89-2f5d4d12bede None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.502968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a58807-3669-4bd2-af89-2f5d4d12bede None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.503441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a58807-3669-4bd2-af89-2f5d4d12bede None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.514323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80531655-f75a-46c4-84e7-4062e53bbd9f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.520962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a58807-3669-4bd2-af89-2f5d4d12bede None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.523254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a58807-3669-4bd2-af89-2f5d4d12bede None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.528503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 179/347] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:32:59.529580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a58807-3669-4bd2-af89-2f5d4d12bede None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.559182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc52798-f600-4bd6-a3ff-532cf134f243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.560979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc52798-f600-4bd6-a3ff-532cf134f243 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.561257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc52798-f600-4bd6-a3ff-532cf134f243 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.561527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc52798-f600-4bd6-a3ff-532cf134f243 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.586041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc52798-f600-4bd6-a3ff-532cf134f243 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-dcc52798-f600-4bd6-a3ff-532cf134f243 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:59.599384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:59.600383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:32:59.601706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 169/348] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:59.606138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc52798-f600-4bd6-a3ff-532cf134f243 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.704788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.735998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a58807-3669-4bd2-af89-2f5d4d12bede None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.776126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338858cb-992a-496b-8a4a-e5ee257c7dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.777658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338858cb-992a-496b-8a4a-e5ee257c7dd4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.777658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338858cb-992a-496b-8a4a-e5ee257c7dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.777658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338858cb-992a-496b-8a4a-e5ee257c7dd4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.786194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc52798-f600-4bd6-a3ff-532cf134f243 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.789782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338858cb-992a-496b-8a4a-e5ee257c7dd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-338858cb-992a-496b-8a4a-e5ee257c7dd4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:32:59.793296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:32:59.794545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:32:59.795360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:32:59.796029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 180/349] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:32:59.796510 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338858cb-992a-496b-8a4a-e5ee257c7dd4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.830236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:32:59.845678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa4fee-ae4c-4a56-bf5e-69d614af1631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.846389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa4fee-ae4c-4a56-bf5e-69d614af1631 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.846742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa4fee-ae4c-4a56-bf5e-69d614af1631 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.847147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa4fee-ae4c-4a56-bf5e-69d614af1631 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.847966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa4fee-ae4c-4a56-bf5e-69d614af1631 None admin] RBAC: Adding query filter params (group.id=15b22df2a8b94877996e8cab0004cf06, role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=f523dae04dcf427480a7d92c16eb5781) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:59.848443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa4fee-ae4c-4a56-bf5e-69d614af1631 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.850043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa4fee-ae4c-4a56-bf5e-69d614af1631 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.856194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 170/350] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/role_assignments?group.id=15b22df2a8b94877996e8cab0004cf06&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 260 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:59.858292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e078-3027-41b7-b5e0-00ebd5bf3b2a None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.858746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e078-3027-41b7-b5e0-00ebd5bf3b2a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.859162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e078-3027-41b7-b5e0-00ebd5bf3b2a None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.860966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 171/351] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:32:59.866516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17e078-3027-41b7-b5e0-00ebd5bf3b2a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:32:59.925609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338858cb-992a-496b-8a4a-e5ee257c7dd4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:32:59.970658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413b10c-521e-4a17-9984-ee2232d14a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:32:59.971630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413b10c-521e-4a17-9984-ee2232d14a87 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:32:59.972109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413b10c-521e-4a17-9984-ee2232d14a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:32:59.972558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d413b10c-521e-4a17-9984-ee2232d14a87 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:32:59.973424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413b10c-521e-4a17-9984-ee2232d14a87 None admin] RBAC: Adding query filter params (name=member) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:32:59.973910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413b10c-521e-4a17-9984-ee2232d14a87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:32:59.975602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d413b10c-521e-4a17-9984-ee2232d14a87 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:32:59.985875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 181/352] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:32:59.987133 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413b10c-521e-4a17-9984-ee2232d14a87 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:00.012993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17e078-3027-41b7-b5e0-00ebd5bf3b2a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:00.028863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:00.063009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a4684-52e0-44fb-a32e-0e407c206206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:00.063703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4684-52e0-44fb-a32e-0e407c206206 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.063987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4684-52e0-44fb-a32e-0e407c206206 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.064263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a4684-52e0-44fb-a32e-0e407c206206 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.078744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a4684-52e0-44fb-a32e-0e407c206206 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-fa4a4684-52e0-44fb-a32e-0e407c206206 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:00.083618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:00.084537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:00.085337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 172/353] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:00.086600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4bc28-8d53-4db6-a47f-cf18395ae957 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.086600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4bc28-8d53-4db6-a47f-cf18395ae957 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.088031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca4bc28-8d53-4db6-a47f-cf18395ae957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.108786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-cca4bc28-8d53-4db6-a47f-cf18395ae957 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:00.109986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cca4bc28-8d53-4db6-a47f-cf18395ae957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:00.132225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:00.148741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d413b10c-521e-4a17-9984-ee2232d14a87 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:00.195086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fd748-11ac-4ce7-a529-cc31d42eb214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:00.196577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fd748-11ac-4ce7-a529-cc31d42eb214 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.196577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fd748-11ac-4ce7-a529-cc31d42eb214 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.196577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973fd748-11ac-4ce7-a529-cc31d42eb214 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.196972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fd748-11ac-4ce7-a529-cc31d42eb214 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:00.197280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fd748-11ac-4ce7-a529-cc31d42eb214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:00.198649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973fd748-11ac-4ce7-a529-cc31d42eb214 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:00.200201 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 173/354] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:00.201191 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4bc28-8d53-4db6-a47f-cf18395ae957 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:00.212793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 182/355] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:32:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:00.214252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fd748-11ac-4ce7-a529-cc31d42eb214 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:00.335843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973fd748-11ac-4ce7-a529-cc31d42eb214 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:00.347235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:00.351398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca4bc28-8d53-4db6-a47f-cf18395ae957 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:00.384398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ac1eb-4a8b-4b0b-aaa1-096a0e6e692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:00.385113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac1eb-4a8b-4b0b-aaa1-096a0e6e692a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.385397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac1eb-4a8b-4b0b-aaa1-096a0e6e692a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.385674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ac1eb-4a8b-4b0b-aaa1-096a0e6e692a None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.386347 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ac1eb-4a8b-4b0b-aaa1-096a0e6e692a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:00.389182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ac1eb-4a8b-4b0b-aaa1-096a0e6e692a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:00.390265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44ac1eb-4a8b-4b0b-aaa1-096a0e6e692a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:00.402416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23348dfc-9076-4b32-90b8-27c71892459a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:00.403443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23348dfc-9076-4b32-90b8-27c71892459a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.403641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 183/356] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:00.404113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23348dfc-9076-4b32-90b8-27c71892459a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.404583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23348dfc-9076-4b32-90b8-27c71892459a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.404955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93a918-95b1-42e7-a235-d6f2530f08f0 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.405240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93a918-95b1-42e7-a235-d6f2530f08f0 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.405512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93a918-95b1-42e7-a235-d6f2530f08f0 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.407078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 184/357] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:00.407813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93a918-95b1-42e7-a235-d6f2530f08f0 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:00.431956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:00.498121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23348dfc-9076-4b32-90b8-27c71892459a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:00.499617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23348dfc-9076-4b32-90b8-27c71892459a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:00.549614 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93a918-95b1-42e7-a235-d6f2530f08f0 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:00.601423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae874e-c55b-431d-9ad7-71805cdee8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:00.602057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae874e-c55b-431d-9ad7-71805cdee8dd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.602340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae874e-c55b-431d-9ad7-71805cdee8dd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.602614 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae874e-c55b-431d-9ad7-71805cdee8dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.617167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:00.623941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 174/358] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:00.625260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe8fb0-e81f-421a-9c3f-054efa8316b1 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.625548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe8fb0-e81f-421a-9c3f-054efa8316b1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.625827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe8fb0-e81f-421a-9c3f-054efa8316b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.647655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f8fe8fb0-e81f-421a-9c3f-054efa8316b1 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:00.649318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f8fe8fb0-e81f-421a-9c3f-054efa8316b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:00.698495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae874e-c55b-431d-9ad7-71805cdee8dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:00.700354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae874e-c55b-431d-9ad7-71805cdee8dd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:00.717108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:00.733969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 175/359] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:00.737831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe8fb0-e81f-421a-9c3f-054efa8316b1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:00.821464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 185/360] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:00.822464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae874e-c55b-431d-9ad7-71805cdee8dd None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:00.856246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe8fb0-e81f-421a-9c3f-054efa8316b1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:00.890770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:00.897378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862445ed-3e21-4ad4-8b26-e647a81ce300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:00.897994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862445ed-3e21-4ad4-8b26-e647a81ce300 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:00.898272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862445ed-3e21-4ad4-8b26-e647a81ce300 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:00.898547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862445ed-3e21-4ad4-8b26-e647a81ce300 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:00.961694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae874e-c55b-431d-9ad7-71805cdee8dd None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:00.981066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:00.988321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862445ed-3e21-4ad4-8b26-e647a81ce300 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:00.989819 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862445ed-3e21-4ad4-8b26-e647a81ce300 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.007793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403ec41-0064-41bd-81f0-269fe67f6394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.008431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403ec41-0064-41bd-81f0-269fe67f6394 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.008710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403ec41-0064-41bd-81f0-269fe67f6394 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.009238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403ec41-0064-41bd-81f0-269fe67f6394 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.023147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403ec41-0064-41bd-81f0-269fe67f6394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-1403ec41-0064-41bd-81f0-269fe67f6394 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:01.028254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:01.029140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:01.029945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 186/361] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:01.030616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403ec41-0064-41bd-81f0-269fe67f6394 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.120460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 176/362] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:01.122102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862445ed-3e21-4ad4-8b26-e647a81ce300 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.150870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403ec41-0064-41bd-81f0-269fe67f6394 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.164997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.193193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9d9e-e9ff-4787-ba07-3e42ac706fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.193865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9d9e-e9ff-4787-ba07-3e42ac706fca None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.194147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9d9e-e9ff-4787-ba07-3e42ac706fca None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.194439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed9d9e-e9ff-4787-ba07-3e42ac706fca None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.197690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed9d9e-e9ff-4787-ba07-3e42ac706fca None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.197690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed9d9e-e9ff-4787-ba07-3e42ac706fca None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.199181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 187/363] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:01.199497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9d9e-e9ff-4787-ba07-3e42ac706fca None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.249759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.258687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862445ed-3e21-4ad4-8b26-e647a81ce300 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.302596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8a8f-5f5c-465f-8fe7-d6cad9a17336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.303266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8a8f-5f5c-465f-8fe7-d6cad9a17336 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.303581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8a8f-5f5c-465f-8fe7-d6cad9a17336 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.303968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b8a8f-5f5c-465f-8fe7-d6cad9a17336 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.307922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b8a8f-5f5c-465f-8fe7-d6cad9a17336 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.309370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b8a8f-5f5c-465f-8fe7-d6cad9a17336 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.311836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 177/364] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:01.315494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8a8f-5f5c-465f-8fe7-d6cad9a17336 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.323398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed9d9e-e9ff-4787-ba07-3e42ac706fca None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.368389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100027d9-b0cc-4945-9b84-06b7ebd1b5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.369339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100027d9-b0cc-4945-9b84-06b7ebd1b5d5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.369833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100027d9-b0cc-4945-9b84-06b7ebd1b5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.370324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100027d9-b0cc-4945-9b84-06b7ebd1b5d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.371234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100027d9-b0cc-4945-9b84-06b7ebd1b5d5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:01.371758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100027d9-b0cc-4945-9b84-06b7ebd1b5d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.373274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100027d9-b0cc-4945-9b84-06b7ebd1b5d5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.382957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 188/365] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:01.384087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100027d9-b0cc-4945-9b84-06b7ebd1b5d5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.447458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.451182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b8a8f-5f5c-465f-8fe7-d6cad9a17336 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.502651 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b083f56-deb5-4f42-9832-91c9cbec0831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.503402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b083f56-deb5-4f42-9832-91c9cbec0831 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.503766 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b083f56-deb5-4f42-9832-91c9cbec0831 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.504105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b083f56-deb5-4f42-9832-91c9cbec0831 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.507450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100027d9-b0cc-4945-9b84-06b7ebd1b5d5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.510941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.518070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b083f56-deb5-4f42-9832-91c9cbec0831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-2b083f56-deb5-4f42-9832-91c9cbec0831 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:01.523438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:01.524524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:01.525318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:01.525906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 178/366] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:01.529954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b083f56-deb5-4f42-9832-91c9cbec0831 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.558369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c14c62-c5bd-47eb-a5c1-96d73fa3d50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.559006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c14c62-c5bd-47eb-a5c1-96d73fa3d50b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.559291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c14c62-c5bd-47eb-a5c1-96d73fa3d50b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.559599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c14c62-c5bd-47eb-a5c1-96d73fa3d50b None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.563006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c14c62-c5bd-47eb-a5c1-96d73fa3d50b None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.564197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c14c62-c5bd-47eb-a5c1-96d73fa3d50b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.566146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 189/367] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:01.566590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c14c62-c5bd-47eb-a5c1-96d73fa3d50b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.665406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b083f56-deb5-4f42-9832-91c9cbec0831 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.704453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c14c62-c5bd-47eb-a5c1-96d73fa3d50b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.712927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523e35b-7962-4b2a-98e6-5315a4b8b20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.713857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e35b-7962-4b2a-98e6-5315a4b8b20a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.714310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e35b-7962-4b2a-98e6-5315a4b8b20a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.714755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8523e35b-7962-4b2a-98e6-5315a4b8b20a None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.716794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523e35b-7962-4b2a-98e6-5315a4b8b20a None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.718711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8523e35b-7962-4b2a-98e6-5315a4b8b20a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.721255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 179/368] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:01.722182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523e35b-7962-4b2a-98e6-5315a4b8b20a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.745177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248d1c9-9d98-4fae-8371-eb9a2f876d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.745940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248d1c9-9d98-4fae-8371-eb9a2f876d5d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.746288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248d1c9-9d98-4fae-8371-eb9a2f876d5d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.746636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0248d1c9-9d98-4fae-8371-eb9a2f876d5d None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.747918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248d1c9-9d98-4fae-8371-eb9a2f876d5d None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.749556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0248d1c9-9d98-4fae-8371-eb9a2f876d5d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.751278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 190/369] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:01.752127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248d1c9-9d98-4fae-8371-eb9a2f876d5d None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.754739 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.806708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:01.850491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8523e35b-7962-4b2a-98e6-5315a4b8b20a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.870949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0248d1c9-9d98-4fae-8371-eb9a2f876d5d None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:01.893922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e688feb-2b34-40b5-80f7-931017a44f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.894575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e688feb-2b34-40b5-80f7-931017a44f2e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.895407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e688feb-2b34-40b5-80f7-931017a44f2e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.895729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e688feb-2b34-40b5-80f7-931017a44f2e None admin] PATH_INFO: `/v3/users/97f074af413f4afca39c2c16d28329c4` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.896946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e688feb-2b34-40b5-80f7-931017a44f2e None admin] RBAC: Authorizing `identity:get_user(user_id=97f074af413f4afca39c2c16d28329c4)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.899375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e688feb-2b34-40b5-80f7-931017a44f2e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.901298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 180/370] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/users/97f074af413f4afca39c2c16d28329c4 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:01.901919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e688feb-2b34-40b5-80f7-931017a44f2e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:01.923572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9ce3d-6b3f-4eed-ae2e-aa2aea37ebab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:01.924278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9ce3d-6b3f-4eed-ae2e-aa2aea37ebab None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:01.924559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9ce3d-6b3f-4eed-ae2e-aa2aea37ebab None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:01.924828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9ce3d-6b3f-4eed-ae2e-aa2aea37ebab None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:01.925504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9ce3d-6b3f-4eed-ae2e-aa2aea37ebab None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:01.925808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9ce3d-6b3f-4eed-ae2e-aa2aea37ebab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:01.927414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed9ce3d-6b3f-4eed-ae2e-aa2aea37ebab None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:01.936307 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 191/371] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:01.937119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9ce3d-6b3f-4eed-ae2e-aa2aea37ebab None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.032481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.044603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e688feb-2b34-40b5-80f7-931017a44f2e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.073067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed9ce3d-6b3f-4eed-ae2e-aa2aea37ebab None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.074827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.102627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e777a9-54a3-4d85-9907-e0569e2b5fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.103254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e777a9-54a3-4d85-9907-e0569e2b5fa2 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.103568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e777a9-54a3-4d85-9907-e0569e2b5fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.103825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e777a9-54a3-4d85-9907-e0569e2b5fa2 None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.105146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e777a9-54a3-4d85-9907-e0569e2b5fa2 None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.106631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e777a9-54a3-4d85-9907-e0569e2b5fa2 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.108458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 181/372] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.111191 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e777a9-54a3-4d85-9907-e0569e2b5fa2 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.112838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafa436-d61a-4b91-8bb4-1dac03b66391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.113652 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafa436-d61a-4b91-8bb4-1dac03b66391 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.114108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafa436-d61a-4b91-8bb4-1dac03b66391 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.114579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cafa436-d61a-4b91-8bb4-1dac03b66391 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.116186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafa436-d61a-4b91-8bb4-1dac03b66391 None admin] RBAC: Adding query filter params (group.id=15b22df2a8b94877996e8cab0004cf06, role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=d99f908d7e3746a5a68fca96958c366c) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:02.116680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafa436-d61a-4b91-8bb4-1dac03b66391 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.118303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cafa436-d61a-4b91-8bb4-1dac03b66391 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.126099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 192/373] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:01 2022] GET /identity/v3/role_assignments?group.id=15b22df2a8b94877996e8cab0004cf06&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.126925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafa436-d61a-4b91-8bb4-1dac03b66391 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.268994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e777a9-54a3-4d85-9907-e0569e2b5fa2 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.275028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cafa436-d61a-4b91-8bb4-1dac03b66391 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.309205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2d9bf-4291-414b-9a6a-14563c16b192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.309827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d9bf-4291-414b-9a6a-14563c16b192 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.310101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d9bf-4291-414b-9a6a-14563c16b192 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.310373 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2d9bf-4291-414b-9a6a-14563c16b192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.311123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2d9bf-4291-414b-9a6a-14563c16b192 None admin] RBAC: Adding query filter params (group.id=15b22df2a8b94877996e8cab0004cf06, role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=f523dae04dcf427480a7d92c16eb5781) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:02.311433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2d9bf-4291-414b-9a6a-14563c16b192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.312072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b9a61-323d-4085-b81a-143071208834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.312688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b9a61-323d-4085-b81a-143071208834 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.312916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2d9bf-4291-414b-9a6a-14563c16b192 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.313009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b9a61-323d-4085-b81a-143071208834 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.313221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b9a61-323d-4085-b81a-143071208834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.314072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b9a61-323d-4085-b81a-143071208834 None admin] RBAC: Adding query filter params (role.id=43b28df8274a4b678cfbbb3d8eac0f52, user.id=97f074af413f4afca39c2c16d28329c4, scope.system=all) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:02.314382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b9a61-323d-4085-b81a-143071208834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.316086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b9a61-323d-4085-b81a-143071208834 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.320226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 182/374] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/role_assignments?group.id=15b22df2a8b94877996e8cab0004cf06&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.321551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2d9bf-4291-414b-9a6a-14563c16b192 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.344016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 193/375] 10.222.0.25 () {56 vars in 1308 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/role_assignments?user.id=97f074af413f4afca39c2c16d28329c4&scope.system=all&role.id=43b28df8274a4b678cfbbb3d8eac0f52 => generated 510 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.345033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b9a61-323d-4085-b81a-143071208834 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.378254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.408938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.539797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2d9bf-4291-414b-9a6a-14563c16b192 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.552691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b9a61-323d-4085-b81a-143071208834 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:02.593586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee02c85-3627-42e3-a185-577ac3081235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.594272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee02c85-3627-42e3-a185-577ac3081235 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.594559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee02c85-3627-42e3-a185-577ac3081235 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.594833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee02c85-3627-42e3-a185-577ac3081235 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.605968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38360b39-7eab-4a6c-85b0-36fa4dd7b13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:02.606590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38360b39-7eab-4a6c-85b0-36fa4dd7b13d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.606868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38360b39-7eab-4a6c-85b0-36fa4dd7b13d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.607144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38360b39-7eab-4a6c-85b0-36fa4dd7b13d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.607906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38360b39-7eab-4a6c-85b0-36fa4dd7b13d None admin] RBAC: Adding query filter params (group.id=15b22df2a8b94877996e8cab0004cf06, role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=d99f908d7e3746a5a68fca96958c366c) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:02.608213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38360b39-7eab-4a6c-85b0-36fa4dd7b13d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.609653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38360b39-7eab-4a6c-85b0-36fa4dd7b13d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.616329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 194/376] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/role_assignments?group.id=15b22df2a8b94877996e8cab0004cf06&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 260 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:02.617600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d655-3386-466f-9032-fc0dc4114469 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.617880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d655-3386-466f-9032-fc0dc4114469 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.618149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7448d655-3386-466f-9032-fc0dc4114469 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.619660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 195/377] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:02.632361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5cf7-3f63-44de-a9a9-35bbc5924219 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:02.632748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5cf7-3f63-44de-a9a9-35bbc5924219 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:02.633031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5cf7-3f63-44de-a9a9-35bbc5924219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:02.657348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b67e5cf7-3f63-44de-a9a9-35bbc5924219 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:02.659600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b67e5cf7-3f63-44de-a9a9-35bbc5924219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:02.697420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee02c85-3627-42e3-a185-577ac3081235 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:02.699886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee02c85-3627-42e3-a185-577ac3081235 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:02.734584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.766612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 196/378] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:02.842605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 183/379] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:02.848094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e5cf7-3f63-44de-a9a9-35bbc5924219 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:02.871213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:02.976479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e5cf7-3f63-44de-a9a9-35bbc5924219 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:03.017907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84595048-ca77-4642-8d1e-d4d6a594e76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:03.018544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84595048-ca77-4642-8d1e-d4d6a594e76a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:03.018826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84595048-ca77-4642-8d1e-d4d6a594e76a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:03.019108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84595048-ca77-4642-8d1e-d4d6a594e76a None admin] PATH_INFO: `/v3/projects/13165a830a7a4a8b85146503c9ccfc33` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:03.020264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84595048-ca77-4642-8d1e-d4d6a594e76a None admin] RBAC: Authorizing `identity:get_project(project_id=13165a830a7a4a8b85146503c9ccfc33)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:03.021753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84595048-ca77-4642-8d1e-d4d6a594e76a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:03.023712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 197/380] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:02 2022] GET /identity/v3/projects/13165a830a7a4a8b85146503c9ccfc33 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:03.029343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee02c85-3627-42e3-a185-577ac3081235 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:03.133188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee02c85-3627-42e3-a185-577ac3081235 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:03.158865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:03.169077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8cb62-ff22-4830-8842-eeb9de43a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:03.169728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8cb62-ff22-4830-8842-eeb9de43a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:03.173685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8cb62-ff22-4830-8842-eeb9de43a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:03.173685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8cb62-ff22-4830-8842-eeb9de43a9c5 None admin] PATH_INFO: `/v3/groups/60d07b7dc45b4e0caedc40ad367aaeea` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:03.176559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8cb62-ff22-4830-8842-eeb9de43a9c5 None admin] RBAC: Authorizing `identity:get_group(group_id=60d07b7dc45b4e0caedc40ad367aaeea)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:03.178872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc8cb62-ff22-4830-8842-eeb9de43a9c5 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:03.180853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 184/381] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:03 2022] GET /identity/v3/groups/60d07b7dc45b4e0caedc40ad367aaeea => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:03.184007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84595048-ca77-4642-8d1e-d4d6a594e76a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:03.186745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8cb62-ff22-4830-8842-eeb9de43a9c5 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:03.312486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8cb62-ff22-4830-8842-eeb9de43a9c5 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:03.348812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb36ff-88f7-4c96-b25a-e9e633fdb32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:03.349486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb36ff-88f7-4c96-b25a-e9e633fdb32e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:03.349768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb36ff-88f7-4c96-b25a-e9e633fdb32e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:03.350571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb36ff-88f7-4c96-b25a-e9e633fdb32e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:03.351308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb36ff-88f7-4c96-b25a-e9e633fdb32e None admin] RBAC: Adding query filter params (group.id=60d07b7dc45b4e0caedc40ad367aaeea, role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=13165a830a7a4a8b85146503c9ccfc33) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:03.351647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb36ff-88f7-4c96-b25a-e9e633fdb32e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:03.353072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb36ff-88f7-4c96-b25a-e9e633fdb32e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:03.359067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 185/382] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:03 2022] GET /identity/v3/role_assignments?group.id=60d07b7dc45b4e0caedc40ad367aaeea&scope.project.id=13165a830a7a4a8b85146503c9ccfc33&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 260 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:03.394509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:03.402935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84595048-ca77-4642-8d1e-d4d6a594e76a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:03.441525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d73ef2-2484-40a3-972d-c7895df6c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:03.442176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d73ef2-2484-40a3-972d-c7895df6c311 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:03.442454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d73ef2-2484-40a3-972d-c7895df6c311 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:03.442726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d73ef2-2484-40a3-972d-c7895df6c311 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:03.455238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d73ef2-2484-40a3-972d-c7895df6c311 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-76d73ef2-2484-40a3-972d-c7895df6c311 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:03.460439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:03.461415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:03.462205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 198/383] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:03.467861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb36ff-88f7-4c96-b25a-e9e633fdb32e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:03.554601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:03.595560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb36ff-88f7-4c96-b25a-e9e633fdb32e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:03.645674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e9ea0-18cc-454d-b309-4f65fdfa9876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:03.646218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e9ea0-18cc-454d-b309-4f65fdfa9876 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:03.646496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e9ea0-18cc-454d-b309-4f65fdfa9876 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:03.647305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39e9ea0-18cc-454d-b309-4f65fdfa9876 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:03.648048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e9ea0-18cc-454d-b309-4f65fdfa9876 None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:03.648365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e9ea0-18cc-454d-b309-4f65fdfa9876 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:03.649740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39e9ea0-18cc-454d-b309-4f65fdfa9876 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:03.662088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 186/384] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:03.667990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d73ef2-2484-40a3-972d-c7895df6c311 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:03.786069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d73ef2-2484-40a3-972d-c7895df6c311 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:03.822099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158a89-366e-4ce4-8f5d-6ee84f48c8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:03.822721 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158a89-366e-4ce4-8f5d-6ee84f48c8b6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:03.822999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158a89-366e-4ce4-8f5d-6ee84f48c8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:03.823273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc158a89-366e-4ce4-8f5d-6ee84f48c8b6 None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:03.824393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc158a89-366e-4ce4-8f5d-6ee84f48c8b6 None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:03.825928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc158a89-366e-4ce4-8f5d-6ee84f48c8b6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:03.827841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 199/385] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:03 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:03.832943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e9ea0-18cc-454d-b309-4f65fdfa9876 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:03.981748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39e9ea0-18cc-454d-b309-4f65fdfa9876 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:04.003093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:04.017790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a950600d-1228-499a-bf0f-3f90b4288103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:04.029817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950600d-1228-499a-bf0f-3f90b4288103 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:04.029817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950600d-1228-499a-bf0f-3f90b4288103 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:04.029817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a950600d-1228-499a-bf0f-3f90b4288103 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:04.029817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950600d-1228-499a-bf0f-3f90b4288103 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:04.029817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a950600d-1228-499a-bf0f-3f90b4288103 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:04.029817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 187/386] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:03 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:04.030632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158a89-366e-4ce4-8f5d-6ee84f48c8b6 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:04.058889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:04.165268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc158a89-366e-4ce4-8f5d-6ee84f48c8b6 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:04.212199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a390b0f6-72d6-49fa-8064-96e2b69bcaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:04.212874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390b0f6-72d6-49fa-8064-96e2b69bcaac None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:04.213155 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390b0f6-72d6-49fa-8064-96e2b69bcaac None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:04.213435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a390b0f6-72d6-49fa-8064-96e2b69bcaac None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781/groups/15b22df2a8b94877996e8cab0004cf06/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:04.215373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390b0f6-72d6-49fa-8064-96e2b69bcaac None admin] RBAC: Authorizing `identity:create_grant(project_id=f523dae04dcf427480a7d92c16eb5781, group_id=15b22df2a8b94877996e8cab0004cf06, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:04.216848 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a390b0f6-72d6-49fa-8064-96e2b69bcaac None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:04.300600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 200/387] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:04 2022] PUT /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781/groups/15b22df2a8b94877996e8cab0004cf06/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:04.838171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f17b-5966-4844-9e1a-0c84e4cbe83d None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:04.838171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f17b-5966-4844-9e1a-0c84e4cbe83d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:04.838171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f17b-5966-4844-9e1a-0c84e4cbe83d None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:04.839491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 188/388] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:04.851635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a29a67-f9cb-41f5-960e-c410ee3c9926 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:04.851635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a29a67-f9cb-41f5-960e-c410ee3c9926 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:04.851635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a29a67-f9cb-41f5-960e-c410ee3c9926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:04.881951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-43a29a67-f9cb-41f5-960e-c410ee3c9926 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:04.883499 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-43a29a67-f9cb-41f5-960e-c410ee3c9926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:05.025233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 201/389] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:05.396215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1d55a-3d6c-456a-8762-045dd870bdba None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.397248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1d55a-3d6c-456a-8762-045dd870bdba None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.397321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1d55a-3d6c-456a-8762-045dd870bdba None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.398886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 189/390] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:05.403993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c939-5f6d-49fc-9a06-c8328f2dca13 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.404417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c939-5f6d-49fc-9a06-c8328f2dca13 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.404591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d25c939-5f6d-49fc-9a06-c8328f2dca13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.415039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:05.428676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-7d25c939-5f6d-49fc-9a06-c8328f2dca13 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:05.429962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7d25c939-5f6d-49fc-9a06-c8328f2dca13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:05.433842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1d55a-3d6c-456a-8762-045dd870bdba None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:05.541214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 202/391] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:05.552344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a383e-724f-428a-9979-d272a3347c20 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.552942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a383e-724f-428a-9979-d272a3347c20 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.553394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a383e-724f-428a-9979-d272a3347c20 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.554900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 203/392] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:05.559753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332f48-76c6-4c7f-b88a-c11428f5eedf None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.560232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332f48-76c6-4c7f-b88a-c11428f5eedf None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.560676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95332f48-76c6-4c7f-b88a-c11428f5eedf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.596436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-95332f48-76c6-4c7f-b88a-c11428f5eedf None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:05.597638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-95332f48-76c6-4c7f-b88a-c11428f5eedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:05.653211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1d55a-3d6c-456a-8762-045dd870bdba None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:05.673897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 204/393] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:05.723530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b32f74-f66a-4f1a-bce3-de6d0bf8374d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:05.724171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b32f74-f66a-4f1a-bce3-de6d0bf8374d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.724452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b32f74-f66a-4f1a-bce3-de6d0bf8374d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.724758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b32f74-f66a-4f1a-bce3-de6d0bf8374d None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.740484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b32f74-f66a-4f1a-bce3-de6d0bf8374d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-f1b32f74-f66a-4f1a-bce3-de6d0bf8374d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:05.745309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:05.746193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:05.747764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 190/394] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:05.752811 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95332f48-76c6-4c7f-b88a-c11428f5eedf None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:05.860656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:05.865904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b32f74-f66a-4f1a-bce3-de6d0bf8374d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:05.901101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95332f48-76c6-4c7f-b88a-c11428f5eedf None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:05.954635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300e15a-d097-4945-b695-3a7671bec2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:05.955251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e15a-d097-4945-b695-3a7671bec2d8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:05.955545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e15a-d097-4945-b695-3a7671bec2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:05.955823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9300e15a-d097-4945-b695-3a7671bec2d8 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:05.956497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e15a-d097-4945-b695-3a7671bec2d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:05.956798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e15a-d097-4945-b695-3a7671bec2d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:05.958171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9300e15a-d097-4945-b695-3a7671bec2d8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:05.969497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:05.973418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 205/395] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:05.978620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300e15a-d097-4945-b695-3a7671bec2d8 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.033035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b32f74-f66a-4f1a-bce3-de6d0bf8374d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.072051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd26b5-1f1a-404f-8979-4eddbe3186bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.073069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd26b5-1f1a-404f-8979-4eddbe3186bb None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.073553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd26b5-1f1a-404f-8979-4eddbe3186bb None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.074033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd26b5-1f1a-404f-8979-4eddbe3186bb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.085465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd26b5-1f1a-404f-8979-4eddbe3186bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-62bd26b5-1f1a-404f-8979-4eddbe3186bb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:06.091236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:06.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:06.093125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:06.095677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 191/396] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:06.096317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd26b5-1f1a-404f-8979-4eddbe3186bb None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.107430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9300e15a-d097-4945-b695-3a7671bec2d8 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.138862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.148946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e39690-2310-41a9-9fce-d4172e2f11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.155662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e39690-2310-41a9-9fce-d4172e2f11f3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.155662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e39690-2310-41a9-9fce-d4172e2f11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.155662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e39690-2310-41a9-9fce-d4172e2f11f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.162656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e39690-2310-41a9-9fce-d4172e2f11f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-e3e39690-2310-41a9-9fce-d4172e2f11f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:06.167918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:06.168822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:06.169637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:06.171946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 206/397] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:06.172943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e39690-2310-41a9-9fce-d4172e2f11f3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.216658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd26b5-1f1a-404f-8979-4eddbe3186bb None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.218926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.254646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb62dde-e43e-486f-8866-1b661ecb13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.255277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb62dde-e43e-486f-8866-1b661ecb13a8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.255948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb62dde-e43e-486f-8866-1b661ecb13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.256228 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb62dde-e43e-486f-8866-1b661ecb13a8 None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.257636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb62dde-e43e-486f-8866-1b661ecb13a8 None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.259211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb62dde-e43e-486f-8866-1b661ecb13a8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.265077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 192/398] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.265077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb62dde-e43e-486f-8866-1b661ecb13a8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.282077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e39690-2310-41a9-9fce-d4172e2f11f3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.319393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fd7b1c-a70f-4a99-abcc-b42ff0755218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.320032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd7b1c-a70f-4a99-abcc-b42ff0755218 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.320316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd7b1c-a70f-4a99-abcc-b42ff0755218 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.320591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fd7b1c-a70f-4a99-abcc-b42ff0755218 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.321662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd7b1c-a70f-4a99-abcc-b42ff0755218 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:06.321978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd7b1c-a70f-4a99-abcc-b42ff0755218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.323348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fd7b1c-a70f-4a99-abcc-b42ff0755218 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.335265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 207/399] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.335265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437cdfd-0592-4804-b9a7-06a88c12d3ad None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.335265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437cdfd-0592-4804-b9a7-06a88c12d3ad None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.335265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437cdfd-0592-4804-b9a7-06a88c12d3ad None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.335265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 208/400] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:06.335265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437cdfd-0592-4804-b9a7-06a88c12d3ad None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.376512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb62dde-e43e-486f-8866-1b661ecb13a8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.388159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.410552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e701e-e81c-4dea-90e6-49d0fecac392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.411188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e701e-e81c-4dea-90e6-49d0fecac392 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.411444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e701e-e81c-4dea-90e6-49d0fecac392 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.411740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9e701e-e81c-4dea-90e6-49d0fecac392 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.412930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e701e-e81c-4dea-90e6-49d0fecac392 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:06.413240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e701e-e81c-4dea-90e6-49d0fecac392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.414600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9e701e-e81c-4dea-90e6-49d0fecac392 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.423272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 193/401] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.423950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e701e-e81c-4dea-90e6-49d0fecac392 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.445198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437cdfd-0592-4804-b9a7-06a88c12d3ad None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.459484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.481958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58933e13-a5a0-4db2-8d9f-d705470e2f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.481958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58933e13-a5a0-4db2-8d9f-d705470e2f07 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.482244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58933e13-a5a0-4db2-8d9f-d705470e2f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.482330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58933e13-a5a0-4db2-8d9f-d705470e2f07 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.483367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58933e13-a5a0-4db2-8d9f-d705470e2f07 None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.484870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58933e13-a5a0-4db2-8d9f-d705470e2f07 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.491895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 209/402] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.492845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486d9de-5ebb-4a28-a147-1c9624a2b2dd None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.493130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486d9de-5ebb-4a28-a147-1c9624a2b2dd None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.493404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486d9de-5ebb-4a28-a147-1c9624a2b2dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.510739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-e486d9de-5ebb-4a28-a147-1c9624a2b2dd None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:06.512006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e486d9de-5ebb-4a28-a147-1c9624a2b2dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:06.531281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9e701e-e81c-4dea-90e6-49d0fecac392 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.567966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acff1e-47fd-4b02-9b5f-f2c1b2692848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.568686 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acff1e-47fd-4b02-9b5f-f2c1b2692848 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.568971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acff1e-47fd-4b02-9b5f-f2c1b2692848 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.569256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acff1e-47fd-4b02-9b5f-f2c1b2692848 None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.570359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acff1e-47fd-4b02-9b5f-f2c1b2692848 None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.571979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acff1e-47fd-4b02-9b5f-f2c1b2692848 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.574348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 194/403] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.574348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acff1e-47fd-4b02-9b5f-f2c1b2692848 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.590340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 210/404] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:06.591486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486d9de-5ebb-4a28-a147-1c9624a2b2dd None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.638740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.694361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e486d9de-5ebb-4a28-a147-1c9624a2b2dd None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.700429 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acff1e-47fd-4b02-9b5f-f2c1b2692848 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.701943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.733994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1799d9-1b04-413e-afe7-430bb112c5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.734983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1799d9-1b04-413e-afe7-430bb112c5df None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.735493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1799d9-1b04-413e-afe7-430bb112c5df None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.736009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1799d9-1b04-413e-afe7-430bb112c5df None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c/groups/15b22df2a8b94877996e8cab0004cf06/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.738451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1799d9-1b04-413e-afe7-430bb112c5df None admin] RBAC: Authorizing `identity:create_grant(project_id=d99f908d7e3746a5a68fca96958c366c, group_id=15b22df2a8b94877996e8cab0004cf06, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.739795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268176-7133-43d6-a558-59be95cf1031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.740466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268176-7133-43d6-a558-59be95cf1031 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.740743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268176-7133-43d6-a558-59be95cf1031 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.740993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1799d9-1b04-413e-afe7-430bb112c5df None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.741098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f268176-7133-43d6-a558-59be95cf1031 None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.742117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f268176-7133-43d6-a558-59be95cf1031 None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.743531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f268176-7133-43d6-a558-59be95cf1031 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.745417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 195/405] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.746292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268176-7133-43d6-a558-59be95cf1031 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.818649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 211/406] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:06 2022] PUT /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c/groups/15b22df2a8b94877996e8cab0004cf06/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:06.819813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1799d9-1b04-413e-afe7-430bb112c5df None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.850997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f268176-7133-43d6-a558-59be95cf1031 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:06.894051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79700679-c17f-4d39-a2c4-89ef3978fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:06.894051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79700679-c17f-4d39-a2c4-89ef3978fff6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:06.894051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79700679-c17f-4d39-a2c4-89ef3978fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:06.894051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79700679-c17f-4d39-a2c4-89ef3978fff6 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:06.894441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79700679-c17f-4d39-a2c4-89ef3978fff6 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:06.894441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79700679-c17f-4d39-a2c4-89ef3978fff6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:06.894441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 196/407] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:06.894920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79700679-c17f-4d39-a2c4-89ef3978fff6 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:06.948222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:06.965736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1799d9-1b04-413e-afe7-430bb112c5df None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:07.001855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:07.005444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad08cf-2534-442c-ab79-05736f377c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:07.006614 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad08cf-2534-442c-ab79-05736f377c1c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:07.006896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad08cf-2534-442c-ab79-05736f377c1c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:07.007170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad08cf-2534-442c-ab79-05736f377c1c None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:07.008448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad08cf-2534-442c-ab79-05736f377c1c None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:07.016052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad08cf-2534-442c-ab79-05736f377c1c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:07.016739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 212/408] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:07.017791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad08cf-2534-442c-ab79-05736f377c1c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:07.029612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79700679-c17f-4d39-a2c4-89ef3978fff6 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:07.069883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd864c92-d85d-4cb4-abc6-3c16d0705f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:07.070505 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864c92-d85d-4cb4-abc6-3c16d0705f3b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:07.070783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864c92-d85d-4cb4-abc6-3c16d0705f3b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:07.071056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd864c92-d85d-4cb4-abc6-3c16d0705f3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:07.081761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd864c92-d85d-4cb4-abc6-3c16d0705f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-fd864c92-d85d-4cb4-abc6-3c16d0705f3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:07.087571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:07.088472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:07.089361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 197/409] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:07.090033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd864c92-d85d-4cb4-abc6-3c16d0705f3b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:07.131940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad08cf-2534-442c-ab79-05736f377c1c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:07.166714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f045485-30b0-415a-a04d-c872b0d7697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:07.167477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f045485-30b0-415a-a04d-c872b0d7697f None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:07.167790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f045485-30b0-415a-a04d-c872b0d7697f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:07.168067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f045485-30b0-415a-a04d-c872b0d7697f None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781/groups/15b22df2a8b94877996e8cab0004cf06/roles/8715982a4ad3427498d1a73a6891b4d3` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:07.170229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f045485-30b0-415a-a04d-c872b0d7697f None admin] RBAC: Authorizing `identity:create_grant(project_id=f523dae04dcf427480a7d92c16eb5781, group_id=15b22df2a8b94877996e8cab0004cf06, role_id=8715982a4ad3427498d1a73a6891b4d3)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:07.171801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f045485-30b0-415a-a04d-c872b0d7697f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:07.192856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:07.197076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd864c92-d85d-4cb4-abc6-3c16d0705f3b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:07.229898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb74cc4e-52df-453e-ad00-189f90a7d2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:07.230615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74cc4e-52df-453e-ad00-189f90a7d2f7 None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:07.230903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74cc4e-52df-453e-ad00-189f90a7d2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:07.231182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb74cc4e-52df-453e-ad00-189f90a7d2f7 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c/groups/15b22df2a8b94877996e8cab0004cf06/roles/8715982a4ad3427498d1a73a6891b4d3` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:07.233450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74cc4e-52df-453e-ad00-189f90a7d2f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d99f908d7e3746a5a68fca96958c366c, group_id=15b22df2a8b94877996e8cab0004cf06, role_id=8715982a4ad3427498d1a73a6891b4d3)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:07.234915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb74cc4e-52df-453e-ad00-189f90a7d2f7 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:07.290861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 213/410] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:07 2022] PUT /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781/groups/15b22df2a8b94877996e8cab0004cf06/roles/8715982a4ad3427498d1a73a6891b4d3 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:07.292062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3a5f-c372-49a0-9736-068e856e8ffa None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:07.292350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3a5f-c372-49a0-9736-068e856e8ffa None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:07.292619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b3a5f-c372-49a0-9736-068e856e8ffa None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:07.294047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 214/411] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:07.296398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b3a5f-c372-49a0-9736-068e856e8ffa None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:07.331551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 198/412] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:07 2022] PUT /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c/groups/15b22df2a8b94877996e8cab0004cf06/roles/8715982a4ad3427498d1a73a6891b4d3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:07.331551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0623-cdbe-4ea1-947b-0daeb413df49 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:07.331551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0623-cdbe-4ea1-947b-0daeb413df49 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:07.331551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcb0623-cdbe-4ea1-947b-0daeb413df49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:07.351221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8bcb0623-cdbe-4ea1-947b-0daeb413df49 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:07.353358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8bcb0623-cdbe-4ea1-947b-0daeb413df49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:07.368214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:07.449333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 199/413] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:07.527954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b3a5f-c372-49a0-9736-068e856e8ffa None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:07.562772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eff019-ca74-4c3e-86ed-46771438487e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:07.563304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eff019-ca74-4c3e-86ed-46771438487e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:07.563959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eff019-ca74-4c3e-86ed-46771438487e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:07.563959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eff019-ca74-4c3e-86ed-46771438487e None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:07.564566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eff019-ca74-4c3e-86ed-46771438487e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:07.564823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eff019-ca74-4c3e-86ed-46771438487e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:07.566177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eff019-ca74-4c3e-86ed-46771438487e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:07.579203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 215/414] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:07.584734 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb0623-cdbe-4ea1-947b-0daeb413df49 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:07.682422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:07.695121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcb0623-cdbe-4ea1-947b-0daeb413df49 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:07.744808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec1927-1a8f-42fa-bcb9-c8ed117e8b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:07.745461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec1927-1a8f-42fa-bcb9-c8ed117e8b1a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:07.745747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec1927-1a8f-42fa-bcb9-c8ed117e8b1a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:07.746026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec1927-1a8f-42fa-bcb9-c8ed117e8b1a None admin] PATH_INFO: `/v3/groups/60d07b7dc45b4e0caedc40ad367aaeea` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:07.747177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec1927-1a8f-42fa-bcb9-c8ed117e8b1a None admin] RBAC: Authorizing `identity:get_group(group_id=60d07b7dc45b4e0caedc40ad367aaeea)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:07.748683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec1927-1a8f-42fa-bcb9-c8ed117e8b1a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:07.750613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 200/415] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:07 2022] GET /identity/v3/groups/60d07b7dc45b4e0caedc40ad367aaeea => generated 229 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:07.756326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eff019-ca74-4c3e-86ed-46771438487e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:07.825656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec1927-1a8f-42fa-bcb9-c8ed117e8b1a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:07.913574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:07.924582 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eff019-ca74-4c3e-86ed-46771438487e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:07.983533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c447f-9f6b-48e5-93d1-f3f1cdc95909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:07.983533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c447f-9f6b-48e5-93d1-f3f1cdc95909 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:07.983533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c447f-9f6b-48e5-93d1-f3f1cdc95909 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:07.983533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c447f-9f6b-48e5-93d1-f3f1cdc95909 None admin] PATH_INFO: `/v3/projects/13165a830a7a4a8b85146503c9ccfc33` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:07.984785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c447f-9f6b-48e5-93d1-f3f1cdc95909 None admin] RBAC: Authorizing `identity:get_project(project_id=13165a830a7a4a8b85146503c9ccfc33)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:07.987475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1c447f-9f6b-48e5-93d1-f3f1cdc95909 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:07.989297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 216/416] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:07 2022] GET /identity/v3/projects/13165a830a7a4a8b85146503c9ccfc33 => generated 344 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:07.995564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec1927-1a8f-42fa-bcb9-c8ed117e8b1a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:07.997694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c447f-9f6b-48e5-93d1-f3f1cdc95909 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:08.062672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca48693-7d5f-405f-92d7-79aca465a528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:08.063305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca48693-7d5f-405f-92d7-79aca465a528 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:08.063603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca48693-7d5f-405f-92d7-79aca465a528 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:08.063871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca48693-7d5f-405f-92d7-79aca465a528 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:08.083283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca48693-7d5f-405f-92d7-79aca465a528 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-fca48693-7d5f-405f-92d7-79aca465a528 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:08.089390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:08.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:08.091072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:08.093032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 201/417] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:08.099409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca48693-7d5f-405f-92d7-79aca465a528 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:08.140441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:08.172380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c447f-9f6b-48e5-93d1-f3f1cdc95909 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:08.230666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b898ff9-828a-4867-8bda-24c67f7568a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:08.231389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b898ff9-828a-4867-8bda-24c67f7568a5 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:08.231695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b898ff9-828a-4867-8bda-24c67f7568a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:08.231967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b898ff9-828a-4867-8bda-24c67f7568a5 None admin] PATH_INFO: `/v3/projects/13165a830a7a4a8b85146503c9ccfc33/groups/60d07b7dc45b4e0caedc40ad367aaeea/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:08.236331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b898ff9-828a-4867-8bda-24c67f7568a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=13165a830a7a4a8b85146503c9ccfc33, group_id=60d07b7dc45b4e0caedc40ad367aaeea, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:08.237777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b898ff9-828a-4867-8bda-24c67f7568a5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:08.273649 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca48693-7d5f-405f-92d7-79aca465a528 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:08.316967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 217/418] 10.222.0.25 () {58 vars in 1442 bytes} [Tue Oct 4 08:33:07 2022] PUT /identity/v3/projects/13165a830a7a4a8b85146503c9ccfc33/groups/60d07b7dc45b4e0caedc40ad367aaeea/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:08.317175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b23dd-69e0-4fc6-b878-6eb9c046b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:08.317759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b23dd-69e0-4fc6-b878-6eb9c046b67d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:08.318090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b23dd-69e0-4fc6-b878-6eb9c046b67d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:08.318447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b23dd-69e0-4fc6-b878-6eb9c046b67d None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:08.319138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b23dd-69e0-4fc6-b878-6eb9c046b67d None admin] RBAC: Adding query filter params (name=member) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:08.319495 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b23dd-69e0-4fc6-b878-6eb9c046b67d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:08.321041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b23dd-69e0-4fc6-b878-6eb9c046b67d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:08.332162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 202/419] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:08.342438 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b898ff9-828a-4867-8bda-24c67f7568a5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:08.372890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:08.471468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b898ff9-828a-4867-8bda-24c67f7568a5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:08.514222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317708a-a0d3-4ec5-a6bc-42bb45a33a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:08.514835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317708a-a0d3-4ec5-a6bc-42bb45a33a74 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:08.515119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317708a-a0d3-4ec5-a6bc-42bb45a33a74 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:08.515390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317708a-a0d3-4ec5-a6bc-42bb45a33a74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:08.609962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317708a-a0d3-4ec5-a6bc-42bb45a33a74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:08.611395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317708a-a0d3-4ec5-a6bc-42bb45a33a74 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:08.647522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:08.745451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 218/420] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:08.750838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b23dd-69e0-4fc6-b878-6eb9c046b67d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:08.853090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:08.878336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b23dd-69e0-4fc6-b878-6eb9c046b67d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:08.929212 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc327f1-533f-42be-ad04-c8650ead5e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:08.929858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc327f1-533f-42be-ad04-c8650ead5e58 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:08.930140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc327f1-533f-42be-ad04-c8650ead5e58 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:08.930417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc327f1-533f-42be-ad04-c8650ead5e58 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:08.931605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc327f1-533f-42be-ad04-c8650ead5e58 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:08.933233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc327f1-533f-42be-ad04-c8650ead5e58 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:08.935112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 203/421] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:08 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:08.940512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317708a-a0d3-4ec5-a6bc-42bb45a33a74 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:09.071677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317708a-a0d3-4ec5-a6bc-42bb45a33a74 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:09.102808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:09.120643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15131d4-d876-47c8-bc64-d023bade0370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:09.121278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15131d4-d876-47c8-bc64-d023bade0370 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.122298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15131d4-d876-47c8-bc64-d023bade0370 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.122298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15131d4-d876-47c8-bc64-d023bade0370 None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.122977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15131d4-d876-47c8-bc64-d023bade0370 None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:09.124446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15131d4-d876-47c8-bc64-d023bade0370 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:09.126302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 219/422] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:08 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:09.132716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc327f1-533f-42be-ad04-c8650ead5e58 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:09.272546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc327f1-533f-42be-ad04-c8650ead5e58 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:09.329887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49b2cd3-4d09-4fee-98a2-065af3ed5955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:09.330794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b2cd3-4d09-4fee-98a2-065af3ed5955 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.331243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b2cd3-4d09-4fee-98a2-065af3ed5955 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.331736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49b2cd3-4d09-4fee-98a2-065af3ed5955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.332643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b2cd3-4d09-4fee-98a2-065af3ed5955 None admin] RBAC: Adding query filter params (group.id=15b22df2a8b94877996e8cab0004cf06, role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=f523dae04dcf427480a7d92c16eb5781) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:09.333138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b2cd3-4d09-4fee-98a2-065af3ed5955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:09.335405 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49b2cd3-4d09-4fee-98a2-065af3ed5955 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:09.348593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 204/423] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:09 2022] GET /identity/v3/role_assignments?group.id=15b22df2a8b94877996e8cab0004cf06&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 611 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:09.537489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6554e-7a32-44e3-b803-ac8f0211b54e None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.537868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6554e-7a32-44e3-b803-ac8f0211b54e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.538046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb6554e-7a32-44e3-b803-ac8f0211b54e None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.539675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 220/424] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:09.547561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd19c4-7b26-4e34-aba1-14942b8ca676 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.547561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd19c4-7b26-4e34-aba1-14942b8ca676 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.547561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dd19c4-7b26-4e34-aba1-14942b8ca676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.567022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-33dd19c4-7b26-4e34-aba1-14942b8ca676 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:09.569177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-33dd19c4-7b26-4e34-aba1-14942b8ca676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:09.574172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:09.642295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 205/425] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:09.852103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf38ec-0db2-4425-a63c-bae7c5d6237b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.852580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf38ec-0db2-4425-a63c-bae7c5d6237b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.852580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf38ec-0db2-4425-a63c-bae7c5d6237b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.854158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 221/426] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:09.859416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f91d8-5dba-4102-92a3-cec02457cb39 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.859889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f91d8-5dba-4102-92a3-cec02457cb39 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.860069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658f91d8-5dba-4102-92a3-cec02457cb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.881662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-658f91d8-5dba-4102-92a3-cec02457cb39 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:09.882845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-658f91d8-5dba-4102-92a3-cec02457cb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:09.924137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef65f4-f7e4-4ef6-9b1d-25b12b5d8d8b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.924763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef65f4-f7e4-4ef6-9b1d-25b12b5d8d8b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.925042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef65f4-f7e4-4ef6-9b1d-25b12b5d8d8b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.926522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 222/427] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:09.932763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de572b-9788-40e1-ba17-202f312598c2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:09.933299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de572b-9788-40e1-ba17-202f312598c2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:09.933769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de572b-9788-40e1-ba17-202f312598c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:09.956052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-57de572b-9788-40e1-ba17-202f312598c2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:09.957572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-57de572b-9788-40e1-ba17-202f312598c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:09.958917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 206/428] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:09.959810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f91d8-5dba-4102-92a3-cec02457cb39 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.032338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 223/429] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:10.041637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.077240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658f91d8-5dba-4102-92a3-cec02457cb39 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.112603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8015e26-3a03-412f-b51d-9861f5afbf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.113218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8015e26-3a03-412f-b51d-9861f5afbf57 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.113489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8015e26-3a03-412f-b51d-9861f5afbf57 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.113761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8015e26-3a03-412f-b51d-9861f5afbf57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.124996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8015e26-3a03-412f-b51d-9861f5afbf57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-b8015e26-3a03-412f-b51d-9861f5afbf57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:10.130411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:10.131859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:10.132639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 207/430] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:10.137992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de572b-9788-40e1-ba17-202f312598c2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.242016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de572b-9788-40e1-ba17-202f312598c2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.265606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.278951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05db07d-fd46-4008-a218-27a44b02286e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.279596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05db07d-fd46-4008-a218-27a44b02286e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.279915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05db07d-fd46-4008-a218-27a44b02286e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.280192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05db07d-fd46-4008-a218-27a44b02286e None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.280852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05db07d-fd46-4008-a218-27a44b02286e None admin] RBAC: Adding query filter params (name=member) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:10.281150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05db07d-fd46-4008-a218-27a44b02286e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.282511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05db07d-fd46-4008-a218-27a44b02286e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.290923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 224/431] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.296692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8015e26-3a03-412f-b51d-9861f5afbf57 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.304173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05db07d-fd46-4008-a218-27a44b02286e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.429497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05db07d-fd46-4008-a218-27a44b02286e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.432906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8015e26-3a03-412f-b51d-9861f5afbf57 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.465029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.469035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168b1a4-bc18-4180-a22a-4fbf57316a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.469875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168b1a4-bc18-4180-a22a-4fbf57316a6b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.470270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168b1a4-bc18-4180-a22a-4fbf57316a6b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.470550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b168b1a4-bc18-4180-a22a-4fbf57316a6b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.470858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5efbce-a795-474f-a676-43dbbd839609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.471354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5efbce-a795-474f-a676-43dbbd839609 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.471664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5efbce-a795-474f-a676-43dbbd839609 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.471937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5efbce-a795-474f-a676-43dbbd839609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.480979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b168b1a4-bc18-4180-a22a-4fbf57316a6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-b168b1a4-bc18-4180-a22a-4fbf57316a6b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:10.486289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:10.487147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:10.488131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 225/432] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:10.493333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168b1a4-bc18-4180-a22a-4fbf57316a6b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.545599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5efbce-a795-474f-a676-43dbbd839609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.546780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.547029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5efbce-a795-474f-a676-43dbbd839609 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.619006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b168b1a4-bc18-4180-a22a-4fbf57316a6b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.651839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 208/433] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:10.652831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5efbce-a795-474f-a676-43dbbd839609 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.658659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d20b2e-0056-47a5-be54-c165efe7e1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.659294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d20b2e-0056-47a5-be54-c165efe7e1ee None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.659591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d20b2e-0056-47a5-be54-c165efe7e1ee None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.659865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d20b2e-0056-47a5-be54-c165efe7e1ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.670967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d20b2e-0056-47a5-be54-c165efe7e1ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-53d20b2e-0056-47a5-be54-c165efe7e1ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:10.676202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:10.677412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:10.678743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 226/434] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:10.679404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d20b2e-0056-47a5-be54-c165efe7e1ee None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.691029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.774105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5efbce-a795-474f-a676-43dbbd839609 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.784569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d20b2e-0056-47a5-be54-c165efe7e1ee None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.788503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.811073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce778dd4-036b-417b-9594-c6c3f9a23671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.811700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce778dd4-036b-417b-9594-c6c3f9a23671 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.811979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce778dd4-036b-417b-9594-c6c3f9a23671 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.812250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce778dd4-036b-417b-9594-c6c3f9a23671 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.813102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce778dd4-036b-417b-9594-c6c3f9a23671 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:10.813215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce778dd4-036b-417b-9594-c6c3f9a23671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.814539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce778dd4-036b-417b-9594-c6c3f9a23671 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.820966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f624-9bc4-45c6-ac14-bd0d40cbe312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.822048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f624-9bc4-45c6-ac14-bd0d40cbe312 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.827157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 209/435] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.827306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f624-9bc4-45c6-ac14-bd0d40cbe312 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.827306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1f624-9bc4-45c6-ac14-bd0d40cbe312 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.827483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce778dd4-036b-417b-9594-c6c3f9a23671 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.828348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f624-9bc4-45c6-ac14-bd0d40cbe312 None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.830379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1f624-9bc4-45c6-ac14-bd0d40cbe312 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.832177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 227/436] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.836953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f624-9bc4-45c6-ac14-bd0d40cbe312 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:10.919661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:10.929038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce778dd4-036b-417b-9594-c6c3f9a23671 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.942670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1f624-9bc4-45c6-ac14-bd0d40cbe312 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:10.963187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd0ba-d008-4e88-a56b-75ee6c611f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.964061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd0ba-d008-4e88-a56b-75ee6c611f82 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.964507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd0ba-d008-4e88-a56b-75ee6c611f82 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.964922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0cd0ba-d008-4e88-a56b-75ee6c611f82 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.965730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd0ba-d008-4e88-a56b-75ee6c611f82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:10.966179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd0ba-d008-4e88-a56b-75ee6c611f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:10.967692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0cd0ba-d008-4e88-a56b-75ee6c611f82 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:10.978894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd936160-4ef4-4bc0-81fe-b3de6b18fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:10.979551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd936160-4ef4-4bc0-81fe-b3de6b18fc1d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:10.979829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd936160-4ef4-4bc0-81fe-b3de6b18fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:10.980101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd936160-4ef4-4bc0-81fe-b3de6b18fc1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:10.981770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 210/437] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:10.982765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd0ba-d008-4e88-a56b-75ee6c611f82 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.026618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.053036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd936160-4ef4-4bc0-81fe-b3de6b18fc1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.054478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd936160-4ef4-4bc0-81fe-b3de6b18fc1d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.097121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0cd0ba-d008-4e88-a56b-75ee6c611f82 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.131858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12423-1210-4a21-a349-88fe880fba05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.132485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12423-1210-4a21-a349-88fe880fba05 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.132763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12423-1210-4a21-a349-88fe880fba05 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.133036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce12423-1210-4a21-a349-88fe880fba05 None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.134143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce12423-1210-4a21-a349-88fe880fba05 None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.135588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce12423-1210-4a21-a349-88fe880fba05 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.137137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 211/438] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:11.137883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12423-1210-4a21-a349-88fe880fba05 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.154638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 228/439] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:11.155957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874e0b7-521b-446b-9680-7ad81b09d87b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.156243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874e0b7-521b-446b-9680-7ad81b09d87b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.156514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874e0b7-521b-446b-9680-7ad81b09d87b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.157877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 229/440] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:11.158687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874e0b7-521b-446b-9680-7ad81b09d87b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.163142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.228629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.237268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce12423-1210-4a21-a349-88fe880fba05 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.257023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874e0b7-521b-446b-9680-7ad81b09d87b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.270816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565f274-88b4-4e86-9960-daec116db5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.271960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565f274-88b4-4e86-9960-daec116db5e6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.272241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565f274-88b4-4e86-9960-daec116db5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.272514 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565f274-88b4-4e86-9960-daec116db5e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.289988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9c45f-1f6e-459c-8986-7f4afed8fbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.290578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c45f-1f6e-459c-8986-7f4afed8fbde None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.290862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c45f-1f6e-459c-8986-7f4afed8fbde None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.291135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c45f-1f6e-459c-8986-7f4afed8fbde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.291882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c45f-1f6e-459c-8986-7f4afed8fbde None admin] RBAC: Adding query filter params (group.id=15b22df2a8b94877996e8cab0004cf06, role.id=6fb126c9acf74dc9812a7bbcd5b196db, scope.project.id=d99f908d7e3746a5a68fca96958c366c) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:11.292190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c45f-1f6e-459c-8986-7f4afed8fbde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.293691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c45f-1f6e-459c-8986-7f4afed8fbde None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.299169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 230/441] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/role_assignments?group.id=15b22df2a8b94877996e8cab0004cf06&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=6fb126c9acf74dc9812a7bbcd5b196db => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:11.299961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9c45f-1f6e-459c-8986-7f4afed8fbde None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.347411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565f274-88b4-4e86-9960-daec116db5e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.348921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565f274-88b4-4e86-9960-daec116db5e6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.376588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.422763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9c45f-1f6e-459c-8986-7f4afed8fbde None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.459998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98323f2-514a-4653-a6b3-7211265fd864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.460939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98323f2-514a-4653-a6b3-7211265fd864 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.461400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98323f2-514a-4653-a6b3-7211265fd864 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.461669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98323f2-514a-4653-a6b3-7211265fd864 None admin] PATH_INFO: `/v3/projects/f523dae04dcf427480a7d92c16eb5781` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.462849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98323f2-514a-4653-a6b3-7211265fd864 None admin] RBAC: Authorizing `identity:get_project(project_id=f523dae04dcf427480a7d92c16eb5781)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.468058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 212/442] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:11.468208 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98323f2-514a-4653-a6b3-7211265fd864 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.468319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9ed67-a6ca-42f2-9b53-aff0c110a72d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.468319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9ed67-a6ca-42f2-9b53-aff0c110a72d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.468319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f9ed67-a6ca-42f2-9b53-aff0c110a72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.470522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 231/443] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/projects/f523dae04dcf427480a7d92c16eb5781 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:11.471553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98323f2-514a-4653-a6b3-7211265fd864 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.475184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.487789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-14f9ed67-a6ca-42f2-9b53-aff0c110a72d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:11.487789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-14f9ed67-a6ca-42f2-9b53-aff0c110a72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:11.561085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 213/444] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:11.561810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9ed67-a6ca-42f2-9b53-aff0c110a72d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.590941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98323f2-514a-4653-a6b3-7211265fd864 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.623829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.624096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2027edf-9437-4deb-90bc-b92f273bbe12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.624718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2027edf-9437-4deb-90bc-b92f273bbe12 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.625154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2027edf-9437-4deb-90bc-b92f273bbe12 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.625299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2027edf-9437-4deb-90bc-b92f273bbe12 None admin] PATH_INFO: `/v3/projects/d99f908d7e3746a5a68fca96958c366c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.626377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2027edf-9437-4deb-90bc-b92f273bbe12 None admin] RBAC: Authorizing `identity:get_project(project_id=d99f908d7e3746a5a68fca96958c366c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.627862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2027edf-9437-4deb-90bc-b92f273bbe12 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.629571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 232/445] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/projects/d99f908d7e3746a5a68fca96958c366c => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:11.635539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2027edf-9437-4deb-90bc-b92f273bbe12 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.673697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f9ed67-a6ca-42f2-9b53-aff0c110a72d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.711079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.712517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4dbbf-5cf6-4366-be9f-c52303ddef14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.713148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4dbbf-5cf6-4366-be9f-c52303ddef14 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.713428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4dbbf-5cf6-4366-be9f-c52303ddef14 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.713700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4dbbf-5cf6-4366-be9f-c52303ddef14 None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.714872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4dbbf-5cf6-4366-be9f-c52303ddef14 None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.716325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4dbbf-5cf6-4366-be9f-c52303ddef14 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.717882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 214/446] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:11.723610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4dbbf-5cf6-4366-be9f-c52303ddef14 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.740461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2027edf-9437-4deb-90bc-b92f273bbe12 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.776591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46a4cd-5806-4369-b524-4dd08e10b8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.777220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46a4cd-5806-4369-b524-4dd08e10b8bc None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.777500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46a4cd-5806-4369-b524-4dd08e10b8bc None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.777908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b46a4cd-5806-4369-b524-4dd08e10b8bc None admin] PATH_INFO: `/v3/groups/15b22df2a8b94877996e8cab0004cf06` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.778927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46a4cd-5806-4369-b524-4dd08e10b8bc None admin] RBAC: Authorizing `identity:get_group(group_id=15b22df2a8b94877996e8cab0004cf06)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.780395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b46a4cd-5806-4369-b524-4dd08e10b8bc None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.782222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 233/447] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/groups/15b22df2a8b94877996e8cab0004cf06 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:11.788159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46a4cd-5806-4369-b524-4dd08e10b8bc None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.833392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4dbbf-5cf6-4366-be9f-c52303ddef14 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.854021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:11.868941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbe8c1-7b3b-4f7a-abfa-8615cfa41e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.869529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbe8c1-7b3b-4f7a-abfa-8615cfa41e22 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.869809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbe8c1-7b3b-4f7a-abfa-8615cfa41e22 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.870082 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbe8c1-7b3b-4f7a-abfa-8615cfa41e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.870842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbe8c1-7b3b-4f7a-abfa-8615cfa41e22 None admin] RBAC: Adding query filter params (group.id=15b22df2a8b94877996e8cab0004cf06, role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=f523dae04dcf427480a7d92c16eb5781) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:11.871146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbe8c1-7b3b-4f7a-abfa-8615cfa41e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.872585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbe8c1-7b3b-4f7a-abfa-8615cfa41e22 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.878135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 215/448] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/role_assignments?group.id=15b22df2a8b94877996e8cab0004cf06&scope.project.id=f523dae04dcf427480a7d92c16eb5781&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:11.880415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbe8c1-7b3b-4f7a-abfa-8615cfa41e22 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:11.890475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b46a4cd-5806-4369-b524-4dd08e10b8bc None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:11.927178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f4152-77eb-425c-a3e3-3c72fce3cf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:11.928344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f4152-77eb-425c-a3e3-3c72fce3cf8e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:11.928626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f4152-77eb-425c-a3e3-3c72fce3cf8e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:11.928899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f4152-77eb-425c-a3e3-3c72fce3cf8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:11.929644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f4152-77eb-425c-a3e3-3c72fce3cf8e None admin] RBAC: Adding query filter params (group.id=15b22df2a8b94877996e8cab0004cf06, role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=d99f908d7e3746a5a68fca96958c366c) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:11.929956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f4152-77eb-425c-a3e3-3c72fce3cf8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:11.931433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f4152-77eb-425c-a3e3-3c72fce3cf8e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:11.938072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 234/449] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/role_assignments?group.id=15b22df2a8b94877996e8cab0004cf06&scope.project.id=d99f908d7e3746a5a68fca96958c366c&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:12.003894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbe8c1-7b3b-4f7a-abfa-8615cfa41e22 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.042934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53933c5e-ccb4-496e-9866-976577ea0842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.043653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933c5e-ccb4-496e-9866-976577ea0842 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.043940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933c5e-ccb4-496e-9866-976577ea0842 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.044214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53933c5e-ccb4-496e-9866-976577ea0842 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.056973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53933c5e-ccb4-496e-9866-976577ea0842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-53933c5e-ccb4-496e-9866-976577ea0842 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:12.062632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:12.069378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:12.070215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 216/450] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:12.070918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f4152-77eb-425c-a3e3-3c72fce3cf8e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.075585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.183645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f4152-77eb-425c-a3e3-3c72fce3cf8e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.217285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a474b-90d9-41fd-aca5-2a2545133c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.217895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a474b-90d9-41fd-aca5-2a2545133c24 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.218177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a474b-90d9-41fd-aca5-2a2545133c24 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.218454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173a474b-90d9-41fd-aca5-2a2545133c24 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.219118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a474b-90d9-41fd-aca5-2a2545133c24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:12.219425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a474b-90d9-41fd-aca5-2a2545133c24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.220814 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173a474b-90d9-41fd-aca5-2a2545133c24 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.229392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 235/451] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:12.235169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53933c5e-ccb4-496e-9866-976577ea0842 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.281610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.337192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53933c5e-ccb4-496e-9866-976577ea0842 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.370988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2596dc-ebd2-44fd-b980-86915900ba4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.371686 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2596dc-ebd2-44fd-b980-86915900ba4d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.371973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2596dc-ebd2-44fd-b980-86915900ba4d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.372245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2596dc-ebd2-44fd-b980-86915900ba4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.438854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2596dc-ebd2-44fd-b980-86915900ba4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.440332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2596dc-ebd2-44fd-b980-86915900ba4d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.483434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.538001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 217/452] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:33:12.543725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a474b-90d9-41fd-aca5-2a2545133c24 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.608797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.640898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173a474b-90d9-41fd-aca5-2a2545133c24 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.673621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1eb89-24ec-4c59-80bd-f4bde4aa3960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.674237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1eb89-24ec-4c59-80bd-f4bde4aa3960 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.674518 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1eb89-24ec-4c59-80bd-f4bde4aa3960 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.674792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf1eb89-24ec-4c59-80bd-f4bde4aa3960 None admin] PATH_INFO: `/v3/projects/13165a830a7a4a8b85146503c9ccfc33` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.675934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1eb89-24ec-4c59-80bd-f4bde4aa3960 None admin] RBAC: Authorizing `identity:get_project(project_id=13165a830a7a4a8b85146503c9ccfc33)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.677684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf1eb89-24ec-4c59-80bd-f4bde4aa3960 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.679283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 236/453] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/projects/13165a830a7a4a8b85146503c9ccfc33 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:12.684827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2596dc-ebd2-44fd-b980-86915900ba4d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.779116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2596dc-ebd2-44fd-b980-86915900ba4d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.811891 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce3f17-e7c9-439d-8063-5ae97b97d805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.812428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce3f17-e7c9-439d-8063-5ae97b97d805 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.812706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce3f17-e7c9-439d-8063-5ae97b97d805 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.812978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce3f17-e7c9-439d-8063-5ae97b97d805 None admin] PATH_INFO: `/v3/groups/60d07b7dc45b4e0caedc40ad367aaeea` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.814072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce3f17-e7c9-439d-8063-5ae97b97d805 None admin] RBAC: Authorizing `identity:get_group(group_id=60d07b7dc45b4e0caedc40ad367aaeea)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.815487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce3f17-e7c9-439d-8063-5ae97b97d805 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.817059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 218/454] 10.222.0.25 () {56 vars in 1180 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/groups/60d07b7dc45b4e0caedc40ad367aaeea => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:12.823219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1eb89-24ec-4c59-80bd-f4bde4aa3960 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:12.919438 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf1eb89-24ec-4c59-80bd-f4bde4aa3960 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:12.951484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bd21d8-e9bf-4cdb-8872-3c7d6413985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:12.952094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd21d8-e9bf-4cdb-8872-3c7d6413985e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:12.952373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd21d8-e9bf-4cdb-8872-3c7d6413985e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:12.952643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bd21d8-e9bf-4cdb-8872-3c7d6413985e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:12.953355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd21d8-e9bf-4cdb-8872-3c7d6413985e None admin] RBAC: Adding query filter params (group.id=60d07b7dc45b4e0caedc40ad367aaeea, role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=13165a830a7a4a8b85146503c9ccfc33) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:12.953662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd21d8-e9bf-4cdb-8872-3c7d6413985e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:12.955075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bd21d8-e9bf-4cdb-8872-3c7d6413985e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:12.956790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:12.961633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 237/455] 10.222.0.25 () {56 vars in 1376 bytes} [Tue Oct 4 08:33:12 2022] GET /identity/v3/role_assignments?group.id=60d07b7dc45b4e0caedc40ad367aaeea&scope.project.id=13165a830a7a4a8b85146503c9ccfc33&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:15.440705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734aa76-59e1-4a1c-af83-fa4599b81188 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.441213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734aa76-59e1-4a1c-af83-fa4599b81188 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.441287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734aa76-59e1-4a1c-af83-fa4599b81188 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.442958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 219/456] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:15.453647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61107-e17e-4d47-abc7-4673aeb2eeb8 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.454434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61107-e17e-4d47-abc7-4673aeb2eeb8 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.454851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61107-e17e-4d47-abc7-4673aeb2eeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.484450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-dbd61107-e17e-4d47-abc7-4673aeb2eeb8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:15.485860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-dbd61107-e17e-4d47-abc7-4673aeb2eeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:15.566073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 238/457] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:15.865603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4e740-8f12-41d3-af8b-e4237e54b0f1 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.866229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4e740-8f12-41d3-af8b-e4237e54b0f1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.866717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4e740-8f12-41d3-af8b-e4237e54b0f1 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.868549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 220/458] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:15.873845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247121d5-222d-4a55-a0ae-0d1426385519 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:15.874372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247121d5-222d-4a55-a0ae-0d1426385519 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:15.874848 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247121d5-222d-4a55-a0ae-0d1426385519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:15.897517 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-247121d5-222d-4a55-a0ae-0d1426385519 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:15.899003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-247121d5-222d-4a55-a0ae-0d1426385519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:15.981776 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 239/459] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:16.048825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4e740-8f12-41d3-af8b-e4237e54b0f1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.068137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:16.171624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfa191-029a-4a20-b4c9-8f0fef849b63 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.171624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfa191-029a-4a20-b4c9-8f0fef849b63 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.171624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cfa191-029a-4a20-b4c9-8f0fef849b63 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.172612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 240/460] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:16.179466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8149fa7-717c-4ab6-8104-10a578a6719a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.180012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8149fa7-717c-4ab6-8104-10a578a6719a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.180489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8149fa7-717c-4ab6-8104-10a578a6719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.184733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4e740-8f12-41d3-af8b-e4237e54b0f1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.201076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f8149fa7-717c-4ab6-8104-10a578a6719a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:16.202812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f8149fa7-717c-4ab6-8104-10a578a6719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:16.246864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6716d-3e7c-477e-aacc-dc01c4b7053f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.247534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6716d-3e7c-477e-aacc-dc01c4b7053f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.247825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6716d-3e7c-477e-aacc-dc01c4b7053f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.248095 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae6716d-3e7c-477e-aacc-dc01c4b7053f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.273829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6716d-3e7c-477e-aacc-dc01c4b7053f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:16.275275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae6716d-3e7c-477e-aacc-dc01c4b7053f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:16.291869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-dae6716d-3e7c-477e-aacc-dc01c4b7053f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:16.301252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:16.303393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:16.304295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:16.304295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:16.304295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:16.307833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 221/461] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:16.308647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6716d-3e7c-477e-aacc-dc01c4b7053f None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.315928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 241/462] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:16.317120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8149fa7-717c-4ab6-8104-10a578a6719a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.387863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:16.432725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae6716d-3e7c-477e-aacc-dc01c4b7053f None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.466621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8149fa7-717c-4ab6-8104-10a578a6719a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.475090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9855885a-518d-4a1d-ba41-87a0ea523ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.476313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855885a-518d-4a1d-ba41-87a0ea523ee6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.476808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855885a-518d-4a1d-ba41-87a0ea523ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.477277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9855885a-518d-4a1d-ba41-87a0ea523ee6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.488533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855885a-518d-4a1d-ba41-87a0ea523ee6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:16.490809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9855885a-518d-4a1d-ba41-87a0ea523ee6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-9855885a-518d-4a1d-ba41-87a0ea523ee6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:16.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:16.507073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:16.507944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:16.507944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:16.507944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:16.508103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66bae43-fd9b-4cdc-8913-680eb7b1b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.508701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bae43-fd9b-4cdc-8913-680eb7b1b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.508993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bae43-fd9b-4cdc-8913-680eb7b1b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.509272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66bae43-fd9b-4cdc-8913-680eb7b1b6f8 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.509920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bae43-fd9b-4cdc-8913-680eb7b1b6f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:16.510226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bae43-fd9b-4cdc-8913-680eb7b1b6f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:16.510936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 222/463] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:16.511622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66bae43-fd9b-4cdc-8913-680eb7b1b6f8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:16.512655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9e49-fccf-4d63-a629-340b96951e21 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.513129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9e49-fccf-4d63-a629-340b96951e21 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.513593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bc9e49-fccf-4d63-a629-340b96951e21 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.515336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 223/464] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:16.517029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc9e49-fccf-4d63-a629-340b96951e21 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.534699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 242/465] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:16.537233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c146-91dc-4691-8dc1-57250faae89f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.537628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c146-91dc-4691-8dc1-57250faae89f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.538093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c9c146-91dc-4691-8dc1-57250faae89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.561399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b5c9c146-91dc-4691-8dc1-57250faae89f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:16.562163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b5c9c146-91dc-4691-8dc1-57250faae89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:16.611098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:16.640559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bc9e49-fccf-4d63-a629-340b96951e21 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.643807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 243/466] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:16.645251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c146-91dc-4691-8dc1-57250faae89f None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.660080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:16.683561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e41ca-627a-40b9-9fc3-00ef56311077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.684263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e41ca-627a-40b9-9fc3-00ef56311077 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.684600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e41ca-627a-40b9-9fc3-00ef56311077 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.684882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575e41ca-627a-40b9-9fc3-00ef56311077 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.685850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e41ca-627a-40b9-9fc3-00ef56311077 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:16.686166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e41ca-627a-40b9-9fc3-00ef56311077 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:16.687842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575e41ca-627a-40b9-9fc3-00ef56311077 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:16.706035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 224/467] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:16.706035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e41ca-627a-40b9-9fc3-00ef56311077 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.769519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c9c146-91dc-4691-8dc1-57250faae89f None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.805602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb9769-20dd-4d1a-bcbf-1074c21265c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.806250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb9769-20dd-4d1a-bcbf-1074c21265c6 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.806825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb9769-20dd-4d1a-bcbf-1074c21265c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.806825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb9769-20dd-4d1a-bcbf-1074c21265c6 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.807495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb9769-20dd-4d1a-bcbf-1074c21265c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:16.809190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacb9769-20dd-4d1a-bcbf-1074c21265c6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:16.833970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575e41ca-627a-40b9-9fc3-00ef56311077 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:16.872457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488febf5-ac4a-46f4-a039-e411edb8aec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:16.873450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488febf5-ac4a-46f4-a039-e411edb8aec8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:16.873920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488febf5-ac4a-46f4-a039-e411edb8aec8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:16.874380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488febf5-ac4a-46f4-a039-e411edb8aec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:16.886865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488febf5-ac4a-46f4-a039-e411edb8aec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:16.888685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488febf5-ac4a-46f4-a039-e411edb8aec8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-488febf5-ac4a-46f4-a039-e411edb8aec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:16.904039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:16.904977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:16.905917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:16.905917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:16.905917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:16.912268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 225/468] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:16.912268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488febf5-ac4a-46f4-a039-e411edb8aec8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.916814 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 244/469] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:16 2022] POST /identity/v3/users => generated 246 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:16.925082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb9769-20dd-4d1a-bcbf-1074c21265c6 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:16.948678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:17.012028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:17.036815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488febf5-ac4a-46f4-a039-e411edb8aec8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.080162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baea7c4-e127-4e37-9f2e-01b7642189f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.080787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baea7c4-e127-4e37-9f2e-01b7642189f2 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.081063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baea7c4-e127-4e37-9f2e-01b7642189f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.081338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baea7c4-e127-4e37-9f2e-01b7642189f2 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.082002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baea7c4-e127-4e37-9f2e-01b7642189f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:17.084030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baea7c4-e127-4e37-9f2e-01b7642189f2 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:17.099549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb9769-20dd-4d1a-bcbf-1074c21265c6 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.134761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beac3f7-1215-4c7a-bbfa-9c0f71920ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.135349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beac3f7-1215-4c7a-bbfa-9c0f71920ad3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.135664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beac3f7-1215-4c7a-bbfa-9c0f71920ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.135932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beac3f7-1215-4c7a-bbfa-9c0f71920ad3 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.136577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beac3f7-1215-4c7a-bbfa-9c0f71920ad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:17.136884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beac3f7-1215-4c7a-bbfa-9c0f71920ad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:17.138239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beac3f7-1215-4c7a-bbfa-9c0f71920ad3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:17.148635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 226/470] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:16 2022] POST /identity/v3/users => generated 248 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:17.149486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baea7c4-e127-4e37-9f2e-01b7642189f2 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:17.152342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 245/471] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:17.152342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e41d8-50b7-4745-9a89-83dffa8882d3 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.152342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e41d8-50b7-4745-9a89-83dffa8882d3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.152342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84e41d8-50b7-4745-9a89-83dffa8882d3 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.155866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 246/472] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:17.158513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e41d8-50b7-4745-9a89-83dffa8882d3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:17.264019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:17.273616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:17.281476 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84e41d8-50b7-4745-9a89-83dffa8882d3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.283923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baea7c4-e127-4e37-9f2e-01b7642189f2 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.322487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0348147-ce76-4fc5-ba1d-8d9c6ea8f023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.322912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2c24a-2ccd-43ed-b5f9-23631f550ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.323136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0348147-ce76-4fc5-ba1d-8d9c6ea8f023 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.323393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0348147-ce76-4fc5-ba1d-8d9c6ea8f023 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.323600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2c24a-2ccd-43ed-b5f9-23631f550ab2 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.323695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0348147-ce76-4fc5-ba1d-8d9c6ea8f023 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.323887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2c24a-2ccd-43ed-b5f9-23631f550ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.324162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2c24a-2ccd-43ed-b5f9-23631f550ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.324349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0348147-ce76-4fc5-ba1d-8d9c6ea8f023 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:17.325911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0348147-ce76-4fc5-ba1d-8d9c6ea8f023 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:17.335835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2c24a-2ccd-43ed-b5f9-23631f550ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:17.338198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2c24a-2ccd-43ed-b5f9-23631f550ab2 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-d0c2c24a-2ccd-43ed-b5f9-23631f550ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:17.356271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:17.357305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:17.358166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:17.358166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:17.358166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:17.358166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 227/473] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:17.359570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8435340-81ab-4b2a-8c52-81dca628c425 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.359570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8435340-81ab-4b2a-8c52-81dca628c425 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.359570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8435340-81ab-4b2a-8c52-81dca628c425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.381523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f8435340-81ab-4b2a-8c52-81dca628c425 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:17.382729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f8435340-81ab-4b2a-8c52-81dca628c425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:17.429885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 247/474] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:17 2022] POST /identity/v3/users => generated 248 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:17.430566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0348147-ce76-4fc5-ba1d-8d9c6ea8f023 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:17.463952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 228/475] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:17.593864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0348147-ce76-4fc5-ba1d-8d9c6ea8f023 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.649132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9031ae-1ee1-4565-9fd4-720c839e8203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.649757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9031ae-1ee1-4565-9fd4-720c839e8203 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.650038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9031ae-1ee1-4565-9fd4-720c839e8203 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.650309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9031ae-1ee1-4565-9fd4-720c839e8203 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.650964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9031ae-1ee1-4565-9fd4-720c839e8203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:17.651267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9031ae-1ee1-4565-9fd4-720c839e8203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:17.652671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9031ae-1ee1-4565-9fd4-720c839e8203 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:17.665089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 248/476] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:17.670187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8435340-81ab-4b2a-8c52-81dca628c425 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:17.747733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:17.785391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8435340-81ab-4b2a-8c52-81dca628c425 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.795948 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9031ae-1ee1-4565-9fd4-720c839e8203 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:17.812949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:17.825857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc558fd-fce5-4d94-97ed-668079084026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.826566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc558fd-fce5-4d94-97ed-668079084026 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.826904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc558fd-fce5-4d94-97ed-668079084026 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.827445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc558fd-fce5-4d94-97ed-668079084026 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.828006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc558fd-fce5-4d94-97ed-668079084026 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:17.829497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc558fd-fce5-4d94-97ed-668079084026 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:17.921890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9031ae-1ee1-4565-9fd4-720c839e8203 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:17.960827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:17.961452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:17.961773 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:17.962105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:17.962797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:17.964188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:17.979491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 229/477] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:17 2022] POST /identity/v3/users => generated 249 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:33:18.013057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.sql.core [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:33:18.013057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 08:33:18.013057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [parameters: {'id': 'c9315d211fe946599fe609130a91c95f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 08:33:18.013057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88127) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application result.read() Oct 04 08:33:18.030178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return ref.to_dict() Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:33:18.031299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application yield resource Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise self.value Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application session.commit() Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:33:18.032455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:33:18.033500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:33:18.034774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application result.read() Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:33:18.035755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [parameters: {'id': 'c9315d211fe946599fe609130a91c95f', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:18.036583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 04 08:33:18.037377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:18.038219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 249/478] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 08:33:17 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:18.041008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc558fd-fce5-4d94-97ed-668079084026 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.180354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc558fd-fce5-4d94-97ed-668079084026 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.203910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:18.216091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62acda50-80ff-422e-a5b4-6d31f87756a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.216731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acda50-80ff-422e-a5b4-6d31f87756a6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.217015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acda50-80ff-422e-a5b4-6d31f87756a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.223039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62acda50-80ff-422e-a5b4-6d31f87756a6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.228883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62acda50-80ff-422e-a5b4-6d31f87756a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-62acda50-80ff-422e-a5b4-6d31f87756a6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:18.233780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:18.234876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 04 08:33:18.235874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:18.237949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 230/479] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:18.247321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:18.334353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:18.362426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea1a0d-2045-4aa9-8bd2-384cad2bdfce None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:18.400372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b363edcc-1843-43b1-96b3-8d866cbb9d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:18.401298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363edcc-1843-43b1-96b3-8d866cbb9d01 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:18.401771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363edcc-1843-43b1-96b3-8d866cbb9d01 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:18.402224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b363edcc-1843-43b1-96b3-8d866cbb9d01 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:18.403056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363edcc-1843-43b1-96b3-8d866cbb9d01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:18.403543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363edcc-1843-43b1-96b3-8d866cbb9d01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:18.405075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b363edcc-1843-43b1-96b3-8d866cbb9d01 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:18.415419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 250/480] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:19.538134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e8f97-a9ca-426d-985f-b8b830322c40 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.538652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e8f97-a9ca-426d-985f-b8b830322c40 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.538652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e8f97-a9ca-426d-985f-b8b830322c40 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.540305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 231/481] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:19.545494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6ae43-47b3-4877-b27b-230c43a163a0 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.545879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6ae43-47b3-4877-b27b-230c43a163a0 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.546040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c6ae43-47b3-4877-b27b-230c43a163a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.565923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-99c6ae43-47b3-4877-b27b-230c43a163a0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:19.567198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-99c6ae43-47b3-4877-b27b-230c43a163a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:19.654216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 251/482] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:19.705055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852bc97-5b35-47a0-904d-86aea0871d05 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.705662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852bc97-5b35-47a0-904d-86aea0871d05 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.706135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852bc97-5b35-47a0-904d-86aea0871d05 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.708553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 232/483] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:19.724097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36667ba-3d83-4d2b-968b-f133f9284dd3 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:19.724379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36667ba-3d83-4d2b-968b-f133f9284dd3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:19.724654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36667ba-3d83-4d2b-968b-f133f9284dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:19.748887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b36667ba-3d83-4d2b-968b-f133f9284dd3 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:19.750077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b36667ba-3d83-4d2b-968b-f133f9284dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:19.833492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:19.845779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 252/484] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:19.934430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852bc97-5b35-47a0-904d-86aea0871d05 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.047487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852bc97-5b35-47a0-904d-86aea0871d05 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.088443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b2a00-c84f-40d0-914d-d382a0fea6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.089378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b2a00-c84f-40d0-914d-d382a0fea6ad None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.089873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b2a00-c84f-40d0-914d-d382a0fea6ad None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.090342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672b2a00-c84f-40d0-914d-d382a0fea6ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.100715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672b2a00-c84f-40d0-914d-d382a0fea6ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-672b2a00-c84f-40d0-914d-d382a0fea6ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:20.105934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:20.106806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:20.107644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:20.110153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 233/485] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:20.116931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36667ba-3d83-4d2b-968b-f133f9284dd3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.224692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b2a00-c84f-40d0-914d-d382a0fea6ad None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.256437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36667ba-3d83-4d2b-968b-f133f9284dd3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.300834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.318448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba51c7-7cef-4413-8634-dd75328a2867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.319062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba51c7-7cef-4413-8634-dd75328a2867 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.319380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba51c7-7cef-4413-8634-dd75328a2867 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.319702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ba51c7-7cef-4413-8634-dd75328a2867 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.321146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba51c7-7cef-4413-8634-dd75328a2867 None admin] RBAC: Adding query filter params (name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:20.321146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba51c7-7cef-4413-8634-dd75328a2867 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.322067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ba51c7-7cef-4413-8634-dd75328a2867 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.330663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 253/486] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:20.336892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba51c7-7cef-4413-8634-dd75328a2867 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.401530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672b2a00-c84f-40d0-914d-d382a0fea6ad None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.447869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.480365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaebdc4-09db-455e-abca-7b640a5bdfd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.483485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaebdc4-09db-455e-abca-7b640a5bdfd1 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.483485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaebdc4-09db-455e-abca-7b640a5bdfd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.483485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaebdc4-09db-455e-abca-7b640a5bdfd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.501511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaebdc4-09db-455e-abca-7b640a5bdfd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-9aaebdc4-09db-455e-abca-7b640a5bdfd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:20.506863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:20.507868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:20.508950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 234/487] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:20.513985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaebdc4-09db-455e-abca-7b640a5bdfd1 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.532593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ba51c7-7cef-4413-8634-dd75328a2867 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.584839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea422bba-36b3-4b4f-bcdf-6b5a51d61075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.585623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422bba-36b3-4b4f-bcdf-6b5a51d61075 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.585777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422bba-36b3-4b4f-bcdf-6b5a51d61075 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.585996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea422bba-36b3-4b4f-bcdf-6b5a51d61075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.601262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422bba-36b3-4b4f-bcdf-6b5a51d61075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.603740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea422bba-36b3-4b4f-bcdf-6b5a51d61075 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-ea422bba-36b3-4b4f-bcdf-6b5a51d61075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:20.623066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:20.624616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:20.626031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:20.626031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:20.626031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:20.628816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 254/488] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:20.628816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e10f88-9008-42aa-882b-68522bf46e40 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.629303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e10f88-9008-42aa-882b-68522bf46e40 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.629465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e10f88-9008-42aa-882b-68522bf46e40 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.630778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 255/489] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:20.631457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e10f88-9008-42aa-882b-68522bf46e40 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.647395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaebdc4-09db-455e-abca-7b640a5bdfd1 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.649788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.695152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317735c-7969-4386-ae6a-a68e6845de1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.695808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317735c-7969-4386-ae6a-a68e6845de1f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.696087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317735c-7969-4386-ae6a-a68e6845de1f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.696359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317735c-7969-4386-ae6a-a68e6845de1f None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.697053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317735c-7969-4386-ae6a-a68e6845de1f None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:20.697360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317735c-7969-4386-ae6a-a68e6845de1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.698763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317735c-7969-4386-ae6a-a68e6845de1f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.719124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 235/490] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:20.721876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be447-348c-4272-b1f9-095cbe071764 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.722165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be447-348c-4272-b1f9-095cbe071764 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.722441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5be447-348c-4272-b1f9-095cbe071764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.749170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9b5be447-348c-4272-b1f9-095cbe071764 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:20.750486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9b5be447-348c-4272-b1f9-095cbe071764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:20.773619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e10f88-9008-42aa-882b-68522bf46e40 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.787917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.813361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2d2bc3-991f-4395-9cf3-a8266631eb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.813996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d2bc3-991f-4395-9cf3-a8266631eb0c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.814273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d2bc3-991f-4395-9cf3-a8266631eb0c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.814543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2d2bc3-991f-4395-9cf3-a8266631eb0c None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.815274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d2bc3-991f-4395-9cf3-a8266631eb0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:20.815605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d2bc3-991f-4395-9cf3-a8266631eb0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.817278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2d2bc3-991f-4395-9cf3-a8266631eb0c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.828068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 236/491] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:20.828068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5be447-348c-4272-b1f9-095cbe071764 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.829960 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 256/492] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:20.832534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e978-f0af-4b7b-9d42-fdba8e534212 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.832534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e978-f0af-4b7b-9d42-fdba8e534212 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.832534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23e978-f0af-4b7b-9d42-fdba8e534212 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.833825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 257/493] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:20.838336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e978-f0af-4b7b-9d42-fdba8e534212 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:20.926187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:20.933730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5be447-348c-4272-b1f9-095cbe071764 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.948456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23e978-f0af-4b7b-9d42-fdba8e534212 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:20.969475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923511fd-095b-46a1-8115-6088a43c96d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.970384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923511fd-095b-46a1-8115-6088a43c96d5 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.970864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923511fd-095b-46a1-8115-6088a43c96d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.971309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923511fd-095b-46a1-8115-6088a43c96d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.982254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923511fd-095b-46a1-8115-6088a43c96d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.984049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923511fd-095b-46a1-8115-6088a43c96d5 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:20.987058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051f8b-02d1-4ca6-9dd1-60d515631184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:20.987766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051f8b-02d1-4ca6-9dd1-60d515631184 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:20.988044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051f8b-02d1-4ca6-9dd1-60d515631184 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:20.988312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87051f8b-02d1-4ca6-9dd1-60d515631184 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:20.996492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051f8b-02d1-4ca6-9dd1-60d515631184 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:20.997982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87051f8b-02d1-4ca6-9dd1-60d515631184 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-923511fd-095b-46a1-8115-6088a43c96d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:21.000765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:21.001645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:21.002494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:21.002494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:21.002494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:21.004348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 237/494] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:21.006450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8ad4-a4c2-4e0d-b5f6-d1c2f50514de None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.006923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8ad4-a4c2-4e0d-b5f6-d1c2f50514de None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.007369 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a8ad4-a4c2-4e0d-b5f6-d1c2f50514de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-87051f8b-02d1-4ca6-9dd1-60d515631184 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:21.016462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:21.017373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:21.018478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 258/495] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:21.019421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051f8b-02d1-4ca6-9dd1-60d515631184 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.031139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-5c9a8ad4-a4c2-4e0d-b5f6-d1c2f50514de None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:21.032506 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5c9a8ad4-a4c2-4e0d-b5f6-d1c2f50514de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:21.053389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.127084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87051f8b-02d1-4ca6-9dd1-60d515631184 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.131577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 238/496] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:21.132642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a8ad4-a4c2-4e0d-b5f6-d1c2f50514de None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.180236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83c3fa-0d48-4dad-bf44-dad35e33bc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.180874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83c3fa-0d48-4dad-bf44-dad35e33bc38 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.181157 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83c3fa-0d48-4dad-bf44-dad35e33bc38 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.181434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e83c3fa-0d48-4dad-bf44-dad35e33bc38 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.182984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83c3fa-0d48-4dad-bf44-dad35e33bc38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:21.183301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83c3fa-0d48-4dad-bf44-dad35e33bc38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.184728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e83c3fa-0d48-4dad-bf44-dad35e33bc38 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.200222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 259/497] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:21.201177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83c3fa-0d48-4dad-bf44-dad35e33bc38 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.236788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.269224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a8ad4-a4c2-4e0d-b5f6-d1c2f50514de None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.315945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.319471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031450a-da74-45c4-b739-0fc3d7b89412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.320119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031450a-da74-45c4-b739-0fc3d7b89412 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.321099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031450a-da74-45c4-b739-0fc3d7b89412 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.321099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031450a-da74-45c4-b739-0fc3d7b89412 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.321440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031450a-da74-45c4-b739-0fc3d7b89412 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:21.321727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031450a-da74-45c4-b739-0fc3d7b89412 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.323540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031450a-da74-45c4-b739-0fc3d7b89412 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.332196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e83c3fa-0d48-4dad-bf44-dad35e33bc38 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.365566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 239/498] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:21.365566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031450a-da74-45c4-b739-0fc3d7b89412 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.373405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7315f4-400d-43de-842a-2e6ee1174104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.374370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7315f4-400d-43de-842a-2e6ee1174104 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.374370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7315f4-400d-43de-842a-2e6ee1174104 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.374622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7315f4-400d-43de-842a-2e6ee1174104 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.385912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7315f4-400d-43de-842a-2e6ee1174104 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-ac7315f4-400d-43de-842a-2e6ee1174104 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:21.390803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:21.391715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:21.392537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 260/499] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:21.393181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1812df-0aab-4979-acb1-6728269e6281 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.394128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1812df-0aab-4979-acb1-6728269e6281 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.394128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1812df-0aab-4979-acb1-6728269e6281 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.399001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 261/500] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:21.399001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1812df-0aab-4979-acb1-6728269e6281 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.475455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031450a-da74-45c4-b739-0fc3d7b89412 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.495428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1812df-0aab-4979-acb1-6728269e6281 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.508049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f083-3254-498c-8689-1f017f351675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.508697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f083-3254-498c-8689-1f017f351675 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.508972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f083-3254-498c-8689-1f017f351675 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.509240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb37f083-3254-498c-8689-1f017f351675 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.511225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.516590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37f083-3254-498c-8689-1f017f351675 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.518024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb37f083-3254-498c-8689-1f017f351675 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.528500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1492-2785-4e26-8085-63b2263c9e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.529094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1492-2785-4e26-8085-63b2263c9e14 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.529374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1492-2785-4e26-8085-63b2263c9e14 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.531704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a1492-2785-4e26-8085-63b2263c9e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-fb37f083-3254-498c-8689-1f017f351675 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:21.531792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:21.537908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 240/501] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:21.538795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f083-3254-498c-8689-1f017f351675 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.548440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.600045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a1492-2785-4e26-8085-63b2263c9e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.601491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a1492-2785-4e26-8085-63b2263c9e14 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.638503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb37f083-3254-498c-8689-1f017f351675 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.671354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5455b-2590-44dc-8340-541e5e1769db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.671996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5455b-2590-44dc-8340-541e5e1769db None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.672663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5455b-2590-44dc-8340-541e5e1769db None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.672941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5455b-2590-44dc-8340-541e5e1769db None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.673603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5455b-2590-44dc-8340-541e5e1769db None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:21.674245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5455b-2590-44dc-8340-541e5e1769db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.675955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5455b-2590-44dc-8340-541e5e1769db None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.684446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 241/502] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:21.685571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07d09-30b6-4b66-b5bd-d012cec676c4 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.685849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07d09-30b6-4b66-b5bd-d012cec676c4 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.686117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c07d09-30b6-4b66-b5bd-d012cec676c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.701915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 262/503] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:21.702744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1492-2785-4e26-8085-63b2263c9e14 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.703879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-21c07d09-30b6-4b66-b5bd-d012cec676c4 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:21.705069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-21c07d09-30b6-4b66-b5bd-d012cec676c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:21.751402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.752631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.768397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 242/504] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:21.769192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07d09-30b6-4b66-b5bd-d012cec676c4 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.800615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a1492-2785-4e26-8085-63b2263c9e14 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.836271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24651a7-fefd-46d1-aa75-054ec9188de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.836889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24651a7-fefd-46d1-aa75-054ec9188de4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.837166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24651a7-fefd-46d1-aa75-054ec9188de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.837434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24651a7-fefd-46d1-aa75-054ec9188de4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.848396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24651a7-fefd-46d1-aa75-054ec9188de4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-d24651a7-fefd-46d1-aa75-054ec9188de4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:21.853626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:21.854723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:21.855700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 263/505] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:21.856370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24651a7-fefd-46d1-aa75-054ec9188de4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.884851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c07d09-30b6-4b66-b5bd-d012cec676c4 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.921362 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089bc5-c8ce-424f-abc7-abce83a80b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:21.922334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089bc5-c8ce-424f-abc7-abce83a80b60 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:21.922815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089bc5-c8ce-424f-abc7-abce83a80b60 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:21.923298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089bc5-c8ce-424f-abc7-abce83a80b60 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:21.924305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089bc5-c8ce-424f-abc7-abce83a80b60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:21.924846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089bc5-c8ce-424f-abc7-abce83a80b60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:21.927269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089bc5-c8ce-424f-abc7-abce83a80b60 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:21.946063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 243/506] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:21.946979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089bc5-c8ce-424f-abc7-abce83a80b60 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:21.967173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24651a7-fefd-46d1-aa75-054ec9188de4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:21.977491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:21.994126 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.000120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f7a70-9583-4f00-8a4c-653fd14a7095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.000742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f7a70-9583-4f00-8a4c-653fd14a7095 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.001349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f7a70-9583-4f00-8a4c-653fd14a7095 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.001349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6f7a70-9583-4f00-8a4c-653fd14a7095 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.013576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f7a70-9583-4f00-8a4c-653fd14a7095 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.014965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6f7a70-9583-4f00-8a4c-653fd14a7095 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-2f6f7a70-9583-4f00-8a4c-653fd14a7095 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:22.029527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:22.030615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:22.031783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:22.031783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.031783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:22.031783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 264/507] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:22.031783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f7a70-9583-4f00-8a4c-653fd14a7095 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.054447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089bc5-c8ce-424f-abc7-abce83a80b60 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.087918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f20008-124a-4415-9389-2d53f50a05e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.088545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f20008-124a-4415-9389-2d53f50a05e2 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.088828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f20008-124a-4415-9389-2d53f50a05e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.089100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f20008-124a-4415-9389-2d53f50a05e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.099706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f20008-124a-4415-9389-2d53f50a05e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.101136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f20008-124a-4415-9389-2d53f50a05e2 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-64f20008-124a-4415-9389-2d53f50a05e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:22.114748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:22.115843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:22.116710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:22.116710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.116710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:22.116710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 244/508] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:22.116986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f20008-124a-4415-9389-2d53f50a05e2 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.128930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6f7a70-9583-4f00-8a4c-653fd14a7095 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.162258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2d793-baef-4a50-a934-b3eca361432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.162856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2d793-baef-4a50-a934-b3eca361432a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.163137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2d793-baef-4a50-a934-b3eca361432a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.163404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee2d793-baef-4a50-a934-b3eca361432a None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.164094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2d793-baef-4a50-a934-b3eca361432a None admin] RBAC: Adding query filter params (name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:22.164399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2d793-baef-4a50-a934-b3eca361432a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.165755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee2d793-baef-4a50-a934-b3eca361432a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.173272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 265/509] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:22.174040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2d793-baef-4a50-a934-b3eca361432a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.203879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.209766 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.215798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f20008-124a-4415-9389-2d53f50a05e2 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.248090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d004ef7-2f11-4a82-82f1-99cb365b5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.248716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004ef7-2f11-4a82-82f1-99cb365b5fdd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.248995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004ef7-2f11-4a82-82f1-99cb365b5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.249267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d004ef7-2f11-4a82-82f1-99cb365b5fdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.274950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee2d793-baef-4a50-a934-b3eca361432a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.307410 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81ae41-226b-4c9e-a7b6-4fa5343a51a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.308026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81ae41-226b-4c9e-a7b6-4fa5343a51a3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.308308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81ae41-226b-4c9e-a7b6-4fa5343a51a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.308578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81ae41-226b-4c9e-a7b6-4fa5343a51a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.309209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81ae41-226b-4c9e-a7b6-4fa5343a51a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:22.309509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81ae41-226b-4c9e-a7b6-4fa5343a51a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.310856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81ae41-226b-4c9e-a7b6-4fa5343a51a3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.318447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d004ef7-2f11-4a82-82f1-99cb365b5fdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.319898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d004ef7-2f11-4a82-82f1-99cb365b5fdd None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.322134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 266/510] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:22.322918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81ae41-226b-4c9e-a7b6-4fa5343a51a3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.402762 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.412368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.417973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81ae41-226b-4c9e-a7b6-4fa5343a51a3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.418805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 245/511] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:22.421828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d004ef7-2f11-4a82-82f1-99cb365b5fdd None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.451448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8d85-634a-42c9-84d2-6dd99be99ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.452089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8d85-634a-42c9-84d2-6dd99be99ffd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.452369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8d85-634a-42c9-84d2-6dd99be99ffd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.452647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cb8d85-634a-42c9-84d2-6dd99be99ffd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.463033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb8d85-634a-42c9-84d2-6dd99be99ffd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.464496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cb8d85-634a-42c9-84d2-6dd99be99ffd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-74cb8d85-634a-42c9-84d2-6dd99be99ffd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:22.479100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:22.480059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:22.486177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:22.486177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.486177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:22.486177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 267/512] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:22.486177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8d85-634a-42c9-84d2-6dd99be99ffd None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.517014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d004ef7-2f11-4a82-82f1-99cb365b5fdd None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.552766 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dfc2c-db59-4fc2-abe7-b80fe6e59e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.553297 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dfc2c-db59-4fc2-abe7-b80fe6e59e3a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.553573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dfc2c-db59-4fc2-abe7-b80fe6e59e3a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.553849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dfc2c-db59-4fc2-abe7-b80fe6e59e3a None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.554883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dfc2c-db59-4fc2-abe7-b80fe6e59e3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:22.555186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dfc2c-db59-4fc2-abe7-b80fe6e59e3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.556919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dfc2c-db59-4fc2-abe7-b80fe6e59e3a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.568433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 246/513] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:22.569100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dfc2c-db59-4fc2-abe7-b80fe6e59e3a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.583495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cb8d85-634a-42c9-84d2-6dd99be99ffd None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.616952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b7e9d-0d5b-4f05-a8d0-81e8347a9639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.617573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7e9d-0d5b-4f05-a8d0-81e8347a9639 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.617854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7e9d-0d5b-4f05-a8d0-81e8347a9639 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.618126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b7e9d-0d5b-4f05-a8d0-81e8347a9639 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.620742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.622570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.628734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b7e9d-0d5b-4f05-a8d0-81e8347a9639 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.635921 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b7e9d-0d5b-4f05-a8d0-81e8347a9639 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-577b7e9d-0d5b-4f05-a8d0-81e8347a9639 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:22.644150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:22.645044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:22.646416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:22.646416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.646416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:22.646416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 268/514] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:22.646635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b7e9d-0d5b-4f05-a8d0-81e8347a9639 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.669079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dfc2c-db59-4fc2-abe7-b80fe6e59e3a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.703316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b484e6-ebf8-4711-a629-bf7ee3bba983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.703977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b484e6-ebf8-4711-a629-bf7ee3bba983 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.704258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b484e6-ebf8-4711-a629-bf7ee3bba983 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.704531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b484e6-ebf8-4711-a629-bf7ee3bba983 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.712499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b484e6-ebf8-4711-a629-bf7ee3bba983 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.713931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b484e6-ebf8-4711-a629-bf7ee3bba983 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-79b484e6-ebf8-4711-a629-bf7ee3bba983 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:22.724748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:22.725718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 247/515] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:22.726593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b484e6-ebf8-4711-a629-bf7ee3bba983 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.749198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b7e9d-0d5b-4f05-a8d0-81e8347a9639 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.782435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c26e-de35-4179-824f-84460118206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.783045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c26e-de35-4179-824f-84460118206e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.784039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c26e-de35-4179-824f-84460118206e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.784039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c636c26e-de35-4179-824f-84460118206e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.794082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636c26e-de35-4179-824f-84460118206e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.795581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c636c26e-de35-4179-824f-84460118206e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-c636c26e-de35-4179-824f-84460118206e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:22.809587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:22.810628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:22.811965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:22.811965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:22.811965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:22.811965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 269/516] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:22.811965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c26e-de35-4179-824f-84460118206e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.827559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b484e6-ebf8-4711-a629-bf7ee3bba983 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.843603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.852117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:22.861120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31075f56-a823-47b8-935d-ecb08cde95c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.861717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31075f56-a823-47b8-935d-ecb08cde95c7 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.861992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31075f56-a823-47b8-935d-ecb08cde95c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.862259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31075f56-a823-47b8-935d-ecb08cde95c7 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.862895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31075f56-a823-47b8-935d-ecb08cde95c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:22.863273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31075f56-a823-47b8-935d-ecb08cde95c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.865233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31075f56-a823-47b8-935d-ecb08cde95c7 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.876681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 248/517] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:22.877542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31075f56-a823-47b8-935d-ecb08cde95c7 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.908475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c636c26e-de35-4179-824f-84460118206e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:22.941968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2d50-921a-44a2-aa99-d9d863fe9fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:22.942588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2d50-921a-44a2-aa99-d9d863fe9fbb None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:22.942909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2d50-921a-44a2-aa99-d9d863fe9fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:22.943188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcf2d50-921a-44a2-aa99-d9d863fe9fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:22.949820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2d50-921a-44a2-aa99-d9d863fe9fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:22.951262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcf2d50-921a-44a2-aa99-d9d863fe9fbb None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-1fcf2d50-921a-44a2-aa99-d9d863fe9fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:22.962935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:22.963802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:22.964640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:22.964640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:22.964640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:22.964640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:22.964640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:22.964640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:22.964640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:22.964640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:22.964640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 270/518] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:22.965102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2d50-921a-44a2-aa99-d9d863fe9fbb None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:22.978169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31075f56-a823-47b8-935d-ecb08cde95c7 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.012143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74f5a-7807-4b27-b2ba-c625b09f1a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.012747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74f5a-7807-4b27-b2ba-c625b09f1a3e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.013023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74f5a-7807-4b27-b2ba-c625b09f1a3e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.013508 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb74f5a-7807-4b27-b2ba-c625b09f1a3e None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.013927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb74f5a-7807-4b27-b2ba-c625b09f1a3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:23.014231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb74f5a-7807-4b27-b2ba-c625b09f1a3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.015642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb74f5a-7807-4b27-b2ba-c625b09f1a3e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.031556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 249/519] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:23.031556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74f5a-7807-4b27-b2ba-c625b09f1a3e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.060638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.063231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcf2d50-921a-44a2-aa99-d9d863fe9fbb None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.065873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.097710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f79555-fe2c-4999-b3a1-1831b4e7bfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.098332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f79555-fe2c-4999-b3a1-1831b4e7bfe7 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.098610 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f79555-fe2c-4999-b3a1-1831b4e7bfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.098905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f79555-fe2c-4999-b3a1-1831b4e7bfe7 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.099656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f79555-fe2c-4999-b3a1-1831b4e7bfe7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:23.099961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f79555-fe2c-4999-b3a1-1831b4e7bfe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.101376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f79555-fe2c-4999-b3a1-1831b4e7bfe7 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.128788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb74f5a-7807-4b27-b2ba-c625b09f1a3e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.137790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 271/520] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:23.138588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f79555-fe2c-4999-b3a1-1831b4e7bfe7 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.166451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fc78b-3ad0-47ba-ae26-5b27b6978767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.167054 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fc78b-3ad0-47ba-ae26-5b27b6978767 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.167327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fc78b-3ad0-47ba-ae26-5b27b6978767 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.167626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058fc78b-3ad0-47ba-ae26-5b27b6978767 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.168259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fc78b-3ad0-47ba-ae26-5b27b6978767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:23.168561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fc78b-3ad0-47ba-ae26-5b27b6978767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.169913 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058fc78b-3ad0-47ba-ae26-5b27b6978767 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.181349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 250/521] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:23.182119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fc78b-3ad0-47ba-ae26-5b27b6978767 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.236287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f79555-fe2c-4999-b3a1-1831b4e7bfe7 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.269687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5462d-24d6-4833-b3f3-1c51c56af19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.270286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5462d-24d6-4833-b3f3-1c51c56af19c None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.270573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5462d-24d6-4833-b3f3-1c51c56af19c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.270846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d5462d-24d6-4833-b3f3-1c51c56af19c None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.271491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5462d-24d6-4833-b3f3-1c51c56af19c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.272961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d5462d-24d6-4833-b3f3-1c51c56af19c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.274530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.279951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058fc78b-3ad0-47ba-ae26-5b27b6978767 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.313100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473aa5-6673-49ba-b864-b08cf0e72cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.313639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473aa5-6673-49ba-b864-b08cf0e72cf7 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.313900 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473aa5-6673-49ba-b864-b08cf0e72cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.314166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da473aa5-6673-49ba-b864-b08cf0e72cf7 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.314846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473aa5-6673-49ba-b864-b08cf0e72cf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:23.315148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473aa5-6673-49ba-b864-b08cf0e72cf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.316579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da473aa5-6673-49ba-b864-b08cf0e72cf7 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.333854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 251/522] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:23.334669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473aa5-6673-49ba-b864-b08cf0e72cf7 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.375071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 272/523] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:23 2022] POST /identity/v3/users => generated 247 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:23.375984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5462d-24d6-4833-b3f3-1c51c56af19c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.394370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.450463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da473aa5-6673-49ba-b864-b08cf0e72cf7 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.486636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d5462d-24d6-4833-b3f3-1c51c56af19c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.490295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec30c9-dee8-4a5f-8e76-9d97e021222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.490946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec30c9-dee8-4a5f-8e76-9d97e021222f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.491226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec30c9-dee8-4a5f-8e76-9d97e021222f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.491497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec30c9-dee8-4a5f-8e76-9d97e021222f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.499813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec30c9-dee8-4a5f-8e76-9d97e021222f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.501421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec30c9-dee8-4a5f-8e76-9d97e021222f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-e0ec30c9-dee8-4a5f-8e76-9d97e021222f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:23.515203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:23.516283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:23.517168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 252/524] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:23.518377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec30c9-dee8-4a5f-8e76-9d97e021222f None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.531134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85feaa-b546-48a4-8417-d07a2b0f85cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.532125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85feaa-b546-48a4-8417-d07a2b0f85cc None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.532416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85feaa-b546-48a4-8417-d07a2b0f85cc None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.532708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85feaa-b546-48a4-8417-d07a2b0f85cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.538825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.611309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85feaa-b546-48a4-8417-d07a2b0f85cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.613035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c85feaa-b546-48a4-8417-d07a2b0f85cc None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.632530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.638450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec30c9-dee8-4a5f-8e76-9d97e021222f None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.674908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffead2-a7de-474c-8a77-01fca4992e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.675557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffead2-a7de-474c-8a77-01fca4992e06 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.675849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffead2-a7de-474c-8a77-01fca4992e06 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.676134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffead2-a7de-474c-8a77-01fca4992e06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.683930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffead2-a7de-474c-8a77-01fca4992e06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.685395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffead2-a7de-474c-8a77-01fca4992e06 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-fbffead2-a7de-474c-8a77-01fca4992e06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:23.697278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:23.698246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:23.699110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:23.699110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:23.699110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:23.699110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:23.699110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:23.699110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:23.699110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:23.699110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:23.699110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 253/525] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:23.700018 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffead2-a7de-474c-8a77-01fca4992e06 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.728464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 273/526] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:23.728464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85feaa-b546-48a4-8417-d07a2b0f85cc None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.787070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.809791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffead2-a7de-474c-8a77-01fca4992e06 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.830786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c85feaa-b546-48a4-8417-d07a2b0f85cc None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:23.844689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec304-52e7-4d49-93a1-94dc5602fa01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.845231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec304-52e7-4d49-93a1-94dc5602fa01 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.845545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec304-52e7-4d49-93a1-94dc5602fa01 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.845791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ec304-52e7-4d49-93a1-94dc5602fa01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.846520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ec304-52e7-4d49-93a1-94dc5602fa01 None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=e05901861bc34c2398ec600150296657) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:23.846831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ec304-52e7-4d49-93a1-94dc5602fa01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.847409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:23.848832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ec304-52e7-4d49-93a1-94dc5602fa01 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.863098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 254/527] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/role_assignments?user.id=e05901861bc34c2398ec600150296657&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:23.863098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec304-52e7-4d49-93a1-94dc5602fa01 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.879244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0dc2-734b-4618-ad8e-324c6f2b79e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:23.880557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0dc2-734b-4618-ad8e-324c6f2b79e2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:23.880913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0dc2-734b-4618-ad8e-324c6f2b79e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:23.881349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ea0dc2-734b-4618-ad8e-324c6f2b79e2 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:23.882312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea0dc2-734b-4618-ad8e-324c6f2b79e2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:23.882654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea0dc2-734b-4618-ad8e-324c6f2b79e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:23.885075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ea0dc2-734b-4618-ad8e-324c6f2b79e2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:23.911773 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 274/528] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:23.912733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0dc2-734b-4618-ad8e-324c6f2b79e2 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:23.988666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ec304-52e7-4d49-93a1-94dc5602fa01 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:24.027682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92ecf7-c478-4452-8db8-7ee787691fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:24.028315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92ecf7-c478-4452-8db8-7ee787691fb9 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:24.028596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92ecf7-c478-4452-8db8-7ee787691fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:24.028875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92ecf7-c478-4452-8db8-7ee787691fb9 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:24.029590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92ecf7-c478-4452-8db8-7ee787691fb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:24.030033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92ecf7-c478-4452-8db8-7ee787691fb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:24.031628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92ecf7-c478-4452-8db8-7ee787691fb9 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:24.035006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ea0dc2-734b-4618-ad8e-324c6f2b79e2 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:24.043019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:24.047410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 255/529] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:24.048391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92ecf7-c478-4452-8db8-7ee787691fb9 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:24.078308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7276921-10ca-4743-adef-ea4a71c93667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:24.079394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276921-10ca-4743-adef-ea4a71c93667 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:24.079864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276921-10ca-4743-adef-ea4a71c93667 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:24.080294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276921-10ca-4743-adef-ea4a71c93667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:24.091868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7276921-10ca-4743-adef-ea4a71c93667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:24.093696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7276921-10ca-4743-adef-ea4a71c93667 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-c7276921-10ca-4743-adef-ea4a71c93667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:24.110322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:24.111446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:24.112631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:24.112631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:24.112631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:24.115677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 275/530] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:24.116473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7276921-10ca-4743-adef-ea4a71c93667 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:24.142472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:24.162943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92ecf7-c478-4452-8db8-7ee787691fb9 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:24.199531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f2ea2-7b6d-4378-9d09-2c238378e42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:24.200157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f2ea2-7b6d-4378-9d09-2c238378e42d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:24.200498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f2ea2-7b6d-4378-9d09-2c238378e42d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:24.200777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f2ea2-7b6d-4378-9d09-2c238378e42d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:24.225931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7276921-10ca-4743-adef-ea4a71c93667 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:24.265707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002430f-774e-419c-b86d-bc7258057eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:24.266803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002430f-774e-419c-b86d-bc7258057eb8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:24.267306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002430f-774e-419c-b86d-bc7258057eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:24.268137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002430f-774e-419c-b86d-bc7258057eb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:24.269280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002430f-774e-419c-b86d-bc7258057eb8 None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=4289134c7df04f96a5c4661165105109) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:24.269729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002430f-774e-419c-b86d-bc7258057eb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:24.272733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002430f-774e-419c-b86d-bc7258057eb8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:24.279617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:24.281873 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 276/531] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:24 2022] GET /identity/v3/role_assignments?user.id=4289134c7df04f96a5c4661165105109&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:24.286000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f2ea2-7b6d-4378-9d09-2c238378e42d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:24.287811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f2ea2-7b6d-4378-9d09-2c238378e42d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:24.288426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002430f-774e-419c-b86d-bc7258057eb8 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:24.412902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 256/532] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:24.418666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f2ea2-7b6d-4378-9d09-2c238378e42d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:24.471162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:24.500820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002430f-774e-419c-b86d-bc7258057eb8 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:24.558412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:24.560943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e8ceb-31f2-4f31-a26d-f239ba1a6e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:24.561739 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f2ea2-7b6d-4378-9d09-2c238378e42d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:24.561854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e8ceb-31f2-4f31-a26d-f239ba1a6e7b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:24.562245 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e8ceb-31f2-4f31-a26d-f239ba1a6e7b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:24.562654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2e8ceb-31f2-4f31-a26d-f239ba1a6e7b None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:24.563694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e8ceb-31f2-4f31-a26d-f239ba1a6e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:24.564952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e8ceb-31f2-4f31-a26d-f239ba1a6e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:24.566472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2e8ceb-31f2-4f31-a26d-f239ba1a6e7b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:24.584749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 277/533] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:24.597504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e8ceb-31f2-4f31-a26d-f239ba1a6e7b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:24.621081 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2431-da2a-4ac2-b136-7aa72550f31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:24.621727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2431-da2a-4ac2-b136-7aa72550f31b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:24.622008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2431-da2a-4ac2-b136-7aa72550f31b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:24.622282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ef2431-da2a-4ac2-b136-7aa72550f31b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:24.643275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef2431-da2a-4ac2-b136-7aa72550f31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:24.644771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ef2431-da2a-4ac2-b136-7aa72550f31b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-80ef2431-da2a-4ac2-b136-7aa72550f31b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:24.670040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:24.671151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:24.672219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:24.672219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:24.672219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:24.682929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 257/534] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:24.683904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2431-da2a-4ac2-b136-7aa72550f31b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:24.791446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2e8ceb-31f2-4f31-a26d-f239ba1a6e7b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:24.851876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e94adb-29a8-4cd8-bd8c-a961a178cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:24.852513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e94adb-29a8-4cd8-bd8c-a961a178cfaa None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:24.852793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e94adb-29a8-4cd8-bd8c-a961a178cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:24.853062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e94adb-29a8-4cd8-bd8c-a961a178cfaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:24.870026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e94adb-29a8-4cd8-bd8c-a961a178cfaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:24.871490 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e94adb-29a8-4cd8-bd8c-a961a178cfaa None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:24.881131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ef2431-da2a-4ac2-b136-7aa72550f31b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-32e94adb-29a8-4cd8-bd8c-a961a178cfaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:24.893285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:24.894231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:24.895775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:24.895775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:24.895775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:24.895775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:24.895775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:24.895775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:24.895775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:24.895775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:24.895775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 278/535] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:24.903841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e94adb-29a8-4cd8-bd8c-a961a178cfaa None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:24.925779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:24.958683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7ddb4-bc93-4a2d-a0b7-f6967008598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:24.959296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7ddb4-bc93-4a2d-a0b7-f6967008598a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:24.959595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7ddb4-bc93-4a2d-a0b7-f6967008598a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:24.959940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7ddb4-bc93-4a2d-a0b7-f6967008598a None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:24.960510 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7ddb4-bc93-4a2d-a0b7-f6967008598a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:24.960813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7ddb4-bc93-4a2d-a0b7-f6967008598a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:24.962173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db7ddb4-bc93-4a2d-a0b7-f6967008598a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:24.988669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 258/536] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:24.992745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7ddb4-bc93-4a2d-a0b7-f6967008598a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:25.016437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:25.089810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e94adb-29a8-4cd8-bd8c-a961a178cfaa None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:25.154157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db7ddb4-bc93-4a2d-a0b7-f6967008598a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:25.156778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f24f0a-981f-4219-86b9-7bfd0749d135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:25.157393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f24f0a-981f-4219-86b9-7bfd0749d135 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:25.157678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f24f0a-981f-4219-86b9-7bfd0749d135 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:25.157951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f24f0a-981f-4219-86b9-7bfd0749d135 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:25.158654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f24f0a-981f-4219-86b9-7bfd0749d135 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:25.158962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f24f0a-981f-4219-86b9-7bfd0749d135 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:25.160432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f24f0a-981f-4219-86b9-7bfd0749d135 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:25.200723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 279/537] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:25.202527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f24f0a-981f-4219-86b9-7bfd0749d135 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:25.213124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcdadf-8597-465b-8f90-ffb7e8896fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:25.214789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcdadf-8597-465b-8f90-ffb7e8896fbb None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:25.218875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcdadf-8597-465b-8f90-ffb7e8896fbb None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:25.219362 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcdadf-8597-465b-8f90-ffb7e8896fbb None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:25.230234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcdadf-8597-465b-8f90-ffb7e8896fbb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:25.231930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcdadf-8597-465b-8f90-ffb7e8896fbb None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-d5fcdadf-8597-465b-8f90-ffb7e8896fbb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:25.250034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:25.250954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:25.251820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:25.251820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:25.251820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:25.251820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:25.251820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:25.251820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:25.251820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:25.251820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:25.260050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 259/538] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:25.265550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcdadf-8597-465b-8f90-ffb7e8896fbb None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:25.335859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:25.392245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:25.396798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f24f0a-981f-4219-86b9-7bfd0749d135 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:25.441097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcdadf-8597-465b-8f90-ffb7e8896fbb None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:25.456524 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1975cf-25e9-4749-a664-3dbe5930ca70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:25.457061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1975cf-25e9-4749-a664-3dbe5930ca70 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:25.457342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1975cf-25e9-4749-a664-3dbe5930ca70 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:25.458162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1975cf-25e9-4749-a664-3dbe5930ca70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:25.458917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1975cf-25e9-4749-a664-3dbe5930ca70 None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=6f4df3626bdb4e3a88ce27eaabf4ca1f) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:25.459229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1975cf-25e9-4749-a664-3dbe5930ca70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:25.460756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1975cf-25e9-4749-a664-3dbe5930ca70 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:25.467356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 280/539] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:25 2022] GET /identity/v3/role_assignments?user.id=6f4df3626bdb4e3a88ce27eaabf4ca1f&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:25.515605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd28e7e-5aa8-40dc-8330-f222bf9bafad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:25.516251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd28e7e-5aa8-40dc-8330-f222bf9bafad None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:25.516536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd28e7e-5aa8-40dc-8330-f222bf9bafad None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:25.516812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd28e7e-5aa8-40dc-8330-f222bf9bafad None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:25.517541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd28e7e-5aa8-40dc-8330-f222bf9bafad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:25.517852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd28e7e-5aa8-40dc-8330-f222bf9bafad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:25.519345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd28e7e-5aa8-40dc-8330-f222bf9bafad None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:25.543028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 260/540] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:25.549253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1975cf-25e9-4749-a664-3dbe5930ca70 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:25.624119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8634638-c317-473e-8cf8-95892ea87dc9 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:25.624403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8634638-c317-473e-8cf8-95892ea87dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:25.624683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8634638-c317-473e-8cf8-95892ea87dc9 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:25.626037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 261/541] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:25.631751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac3c3-f3db-47ab-aeb3-0de8eb9b099b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:25.632037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac3c3-f3db-47ab-aeb3-0de8eb9b099b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:25.632310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ac3c3-f3db-47ab-aeb3-0de8eb9b099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:25.669134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b63ac3c3-f3db-47ab-aeb3-0de8eb9b099b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:25.670446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b63ac3c3-f3db-47ab-aeb3-0de8eb9b099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:25.698763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1975cf-25e9-4749-a664-3dbe5930ca70 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:25.739328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:25.749040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed382f-280a-432d-8003-5466189e28a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:25.749686 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed382f-280a-432d-8003-5466189e28a2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:25.749962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed382f-280a-432d-8003-5466189e28a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:25.750225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fed382f-280a-432d-8003-5466189e28a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:25.750950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed382f-280a-432d-8003-5466189e28a2 None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=a269743c34bc48edaab5c0e3e78074c5) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:25.751250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed382f-280a-432d-8003-5466189e28a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:25.753530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fed382f-280a-432d-8003-5466189e28a2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:25.765369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 281/542] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:25 2022] GET /identity/v3/role_assignments?user.id=a269743c34bc48edaab5c0e3e78074c5&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:25.778181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 262/543] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:26.108198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed382f-280a-432d-8003-5466189e28a2 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:26.224492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fed382f-280a-432d-8003-5466189e28a2 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:26.272147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2290e-3617-48bb-9f5f-04c640b7a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:26.272794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2290e-3617-48bb-9f5f-04c640b7a536 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.273070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2290e-3617-48bb-9f5f-04c640b7a536 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.273339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2290e-3617-48bb-9f5f-04c640b7a536 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.289459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2290e-3617-48bb-9f5f-04c640b7a536 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-6fc2290e-3617-48bb-9f5f-04c640b7a536 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:26.295651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:26.296559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:26.297387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:26.298462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 282/544] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:26.303956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac3c3-f3db-47ab-aeb3-0de8eb9b099b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:26.376470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:26.396032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a0be6-6a97-4506-acd5-2ba9ba4c20bd None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.396321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a0be6-6a97-4506-acd5-2ba9ba4c20bd None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.396601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a0be6-6a97-4506-acd5-2ba9ba4c20bd None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.399676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 283/545] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:26.404956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc3be3-b865-4521-af8e-d33281f509fc None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.405243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc3be3-b865-4521-af8e-d33281f509fc None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.405526 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc3be3-b865-4521-af8e-d33281f509fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.443645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9ddc3be3-b865-4521-af8e-d33281f509fc None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:26.444860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9ddc3be3-b865-4521-af8e-d33281f509fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:26.450753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ac3c3-f3db-47ab-aeb3-0de8eb9b099b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:26.512188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2eb2-f05b-4c45-baaf-210694ce27ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:26.512797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2eb2-f05b-4c45-baaf-210694ce27ba None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.513076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2eb2-f05b-4c45-baaf-210694ce27ba None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.513341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2eb2-f05b-4c45-baaf-210694ce27ba None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.514155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef2eb2-f05b-4c45-baaf-210694ce27ba None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:26.514458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef2eb2-f05b-4c45-baaf-210694ce27ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:26.516816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef2eb2-f05b-4c45-baaf-210694ce27ba None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:26.536152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 263/546] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:26.545866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2eb2-f05b-4c45-baaf-210694ce27ba None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:26.549475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:26.583690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 284/547] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:26.677443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2eb2-f05b-4c45-baaf-210694ce27ba None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:26.701643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:26.717808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4bed-6466-4d37-b030-33cd9e66118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:26.718451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4bed-6466-4d37-b030-33cd9e66118d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.718731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4bed-6466-4d37-b030-33cd9e66118d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.719006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58c4bed-6466-4d37-b030-33cd9e66118d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.734274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4bed-6466-4d37-b030-33cd9e66118d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:26.736114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58c4bed-6466-4d37-b030-33cd9e66118d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-b58c4bed-6466-4d37-b030-33cd9e66118d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:26.756371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:26.757254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:26.758585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:26.758585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:26.758585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:26.760357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 264/548] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:26.766585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc3be3-b865-4521-af8e-d33281f509fc None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:26.919997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc3be3-b865-4521-af8e-d33281f509fc None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:26.960353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40f52-8ea1-4bfb-b817-f43cae7a37bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:26.960969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40f52-8ea1-4bfb-b817-f43cae7a37bb None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:26.961253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40f52-8ea1-4bfb-b817-f43cae7a37bb None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:26.961532 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40f52-8ea1-4bfb-b817-f43cae7a37bb None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:26.962184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a40f52-8ea1-4bfb-b817-f43cae7a37bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:26.962491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a40f52-8ea1-4bfb-b817-f43cae7a37bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:26.963884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a40f52-8ea1-4bfb-b817-f43cae7a37bb None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:26.976654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 285/549] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:26.981858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4bed-6466-4d37-b030-33cd9e66118d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:26.995069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40f52-8ea1-4bfb-b817-f43cae7a37bb None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.094178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.163331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40f52-8ea1-4bfb-b817-f43cae7a37bb None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.164677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58c4bed-6466-4d37-b030-33cd9e66118d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.199947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a063d-be82-4744-a04b-581d095d64cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.200728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a063d-be82-4744-a04b-581d095d64cd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.201105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a063d-be82-4744-a04b-581d095d64cd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.201295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48caaa3-996a-4ebd-8122-93dfbce05f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.201421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a063d-be82-4744-a04b-581d095d64cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.201872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48caaa3-996a-4ebd-8122-93dfbce05f2e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.202151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48caaa3-996a-4ebd-8122-93dfbce05f2e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.202425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48caaa3-996a-4ebd-8122-93dfbce05f2e None admin] PATH_INFO: `/v3/users/swift` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.211324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48caaa3-996a-4ebd-8122-93dfbce05f2e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.212590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681a063d-be82-4744-a04b-581d095d64cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:27.212970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48caaa3-996a-4ebd-8122-93dfbce05f2e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-681a063d-be82-4744-a04b-581d095d64cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:27.218134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:27.219041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:27.220436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 286/550] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:27.221314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ed4e5-1cde-4958-b6f3-d0c0a95a335d None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.221314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ed4e5-1cde-4958-b6f3-d0c0a95a335d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.221314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741ed4e5-1cde-4958-b6f3-d0c0a95a335d None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.222688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 287/551] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:27.227272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ed4e5-1cde-4958-b6f3-d0c0a95a335d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-c48caaa3-996a-4ebd-8122-93dfbce05f2e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:27.229853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:27.230748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 265/552] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:27.232641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d22a1-8d29-4daa-84a1-e37a7a09e57a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.234105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d22a1-8d29-4daa-84a1-e37a7a09e57a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.234105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d22a1-8d29-4daa-84a1-e37a7a09e57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.261212 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ac5d22a1-8d29-4daa-84a1-e37a7a09e57a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:27.262664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ac5d22a1-8d29-4daa-84a1-e37a7a09e57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:27.295460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.340674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741ed4e5-1cde-4958-b6f3-d0c0a95a335d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.341833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 266/553] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:27.342989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d22a1-8d29-4daa-84a1-e37a7a09e57a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.354300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.408260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27c3a-17ef-4309-945f-555d8e9a84d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.409041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c3a-17ef-4309-945f-555d8e9a84d4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.409421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c3a-17ef-4309-945f-555d8e9a84d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.409700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d27c3a-17ef-4309-945f-555d8e9a84d4 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.410706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c3a-17ef-4309-945f-555d8e9a84d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:27.410823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c3a-17ef-4309-945f-555d8e9a84d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.416295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d27c3a-17ef-4309-945f-555d8e9a84d4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.432347 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 288/554] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:27.439805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27c3a-17ef-4309-945f-555d8e9a84d4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.460764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d22a1-8d29-4daa-84a1-e37a7a09e57a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.498738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91852d6-c4d6-4e3d-a1cc-90c3f6b41f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.499755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91852d6-c4d6-4e3d-a1cc-90c3f6b41f46 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.500180 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91852d6-c4d6-4e3d-a1cc-90c3f6b41f46 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.500614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91852d6-c4d6-4e3d-a1cc-90c3f6b41f46 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.501787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91852d6-c4d6-4e3d-a1cc-90c3f6b41f46 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:27.502241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91852d6-c4d6-4e3d-a1cc-90c3f6b41f46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.503979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91852d6-c4d6-4e3d-a1cc-90c3f6b41f46 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.526182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 267/555] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:27.532031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91852d6-c4d6-4e3d-a1cc-90c3f6b41f46 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.560313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.642587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91852d6-c4d6-4e3d-a1cc-90c3f6b41f46 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.667269 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d27c3a-17ef-4309-945f-555d8e9a84d4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:27.682073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b14b16-45ce-4ef3-bbae-18fdd847b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.683392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b14b16-45ce-4ef3-bbae-18fdd847b3a4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.683845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b14b16-45ce-4ef3-bbae-18fdd847b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.684270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b14b16-45ce-4ef3-bbae-18fdd847b3a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.739760 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7cf7d-2769-4cda-8e10-e9861bf589f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:27.740395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7cf7d-2769-4cda-8e10-e9861bf589f5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:27.740677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7cf7d-2769-4cda-8e10-e9861bf589f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:27.740950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe7cf7d-2769-4cda-8e10-e9861bf589f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:27.761148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b14b16-45ce-4ef3-bbae-18fdd847b3a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.762801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b14b16-45ce-4ef3-bbae-18fdd847b3a4 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.764593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7cf7d-2769-4cda-8e10-e9861bf589f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:27.766552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe7cf7d-2769-4cda-8e10-e9861bf589f5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:27.788199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-4fe7cf7d-2769-4cda-8e10-e9861bf589f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:27.796102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:27.797312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:27.798360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:27.798360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:27.798360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:27.798360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 289/556] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:27.806058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7cf7d-2769-4cda-8e10-e9861bf589f5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.848460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:27.881322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 268/557] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 04 08:33:27.887416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b14b16-45ce-4ef3-bbae-18fdd847b3a4 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:27.982464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe7cf7d-2769-4cda-8e10-e9861bf589f5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.003616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b14b16-45ce-4ef3-bbae-18fdd847b3a4 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.028067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6881e-c085-4265-bd5b-ea469385e8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.028880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6881e-c085-4265-bd5b-ea469385e8a1 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.029176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6881e-c085-4265-bd5b-ea469385e8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.029453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6881e-c085-4265-bd5b-ea469385e8a1 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.030112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6881e-c085-4265-bd5b-ea469385e8a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:28.030420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6881e-c085-4265-bd5b-ea469385e8a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.032314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.033179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6881e-c085-4265-bd5b-ea469385e8a1 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.044609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06afc808-91c4-4346-bdd1-59b8975f7308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.048468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc808-91c4-4346-bdd1-59b8975f7308 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.048468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc808-91c4-4346-bdd1-59b8975f7308 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.048468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06afc808-91c4-4346-bdd1-59b8975f7308 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.048805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 290/558] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:28.048805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6881e-c085-4265-bd5b-ea469385e8a1 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.058678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc808-91c4-4346-bdd1-59b8975f7308 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.060276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06afc808-91c4-4346-bdd1-59b8975f7308 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-06afc808-91c4-4346-bdd1-59b8975f7308 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:28.076034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:28.077198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:28.078291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:28.078291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:28.078291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:28.084506 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 269/559] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:28.085497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4dd0-9668-4f2e-8621-66a6d299e224 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.085784 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4dd0-9668-4f2e-8621-66a6d299e224 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.086060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d4dd0-9668-4f2e-8621-66a6d299e224 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.087299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 270/560] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:28.088038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4dd0-9668-4f2e-8621-66a6d299e224 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.137546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.156672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6881e-c085-4265-bd5b-ea469385e8a1 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.194230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cac81-b5c6-44c4-9475-a5ceddfdca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.194943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cac81-b5c6-44c4-9475-a5ceddfdca6e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.195151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cac81-b5c6-44c4-9475-a5ceddfdca6e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.195431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cac81-b5c6-44c4-9475-a5ceddfdca6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.195787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d4dd0-9668-4f2e-8621-66a6d299e224 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.207943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cac81-b5c6-44c4-9475-a5ceddfdca6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-6f8cac81-b5c6-44c4-9475-a5ceddfdca6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:28.213459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:28.214482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:28.215352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 291/561] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:28.216733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cac81-b5c6-44c4-9475-a5ceddfdca6e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.241045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86582a23-f4a6-4f4d-8db4-820531108de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.241679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582a23-f4a6-4f4d-8db4-820531108de1 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.241960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582a23-f4a6-4f4d-8db4-820531108de1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.242235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86582a23-f4a6-4f4d-8db4-820531108de1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.251275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86582a23-f4a6-4f4d-8db4-820531108de1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.252757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86582a23-f4a6-4f4d-8db4-820531108de1 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-86582a23-f4a6-4f4d-8db4-820531108de1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:28.265660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:28.266667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 271/562] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56151f6-ace5-4dc1-9337-233b445029e7 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.268229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56151f6-ace5-4dc1-9337-233b445029e7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.268972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56151f6-ace5-4dc1-9337-233b445029e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.287389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a56151f6-ace5-4dc1-9337-233b445029e7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:28.288548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a56151f6-ace5-4dc1-9337-233b445029e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:28.318956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.328962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cac81-b5c6-44c4-9475-a5ceddfdca6e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.362123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 272/563] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:28.362624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e80e1-b0cd-4d3b-ba50-a9a6089a6b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.362963 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56151f6-ace5-4dc1-9337-233b445029e7 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.363064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e80e1-b0cd-4d3b-ba50-a9a6089a6b4d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.363343 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e80e1-b0cd-4d3b-ba50-a9a6089a6b4d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.363676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5e80e1-b0cd-4d3b-ba50-a9a6089a6b4d None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.364324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e80e1-b0cd-4d3b-ba50-a9a6089a6b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:28.364630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e80e1-b0cd-4d3b-ba50-a9a6089a6b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.366013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5e80e1-b0cd-4d3b-ba50-a9a6089a6b4d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.374120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.377395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 292/564] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:28.378171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e80e1-b0cd-4d3b-ba50-a9a6089a6b4d None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.480639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5e80e1-b0cd-4d3b-ba50-a9a6089a6b4d None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.488376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56151f6-ace5-4dc1-9337-233b445029e7 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.520730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472ada9-2573-4d38-a426-6e2565609023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.521607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472ada9-2573-4d38-a426-6e2565609023 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.522048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472ada9-2573-4d38-a426-6e2565609023 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.522326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e472ada9-2573-4d38-a426-6e2565609023 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.523071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472ada9-2573-4d38-a426-6e2565609023 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:28.523369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472ada9-2573-4d38-a426-6e2565609023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.524843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e472ada9-2573-4d38-a426-6e2565609023 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.526786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3ed5b-1b34-4cc8-8d41-9234580fc4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.527583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3ed5b-1b34-4cc8-8d41-9234580fc4f3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.528026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3ed5b-1b34-4cc8-8d41-9234580fc4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.528447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3ed5b-1b34-4cc8-8d41-9234580fc4f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.529363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3ed5b-1b34-4cc8-8d41-9234580fc4f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:28.529815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3ed5b-1b34-4cc8-8d41-9234580fc4f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.531310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3ed5b-1b34-4cc8-8d41-9234580fc4f3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.540166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 273/565] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:28.541504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e55b8-d2fc-409a-85a7-a73731726bec None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.541790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e55b8-d2fc-409a-85a7-a73731726bec None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.542074 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e55b8-d2fc-409a-85a7-a73731726bec None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.546857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 274/566] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:28.546857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e55b8-d2fc-409a-85a7-a73731726bec None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.549361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 293/567] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:28.553785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472ada9-2573-4d38-a426-6e2565609023 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.576638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.611385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.652372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e472ada9-2573-4d38-a426-6e2565609023 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.654731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e55b8-d2fc-409a-85a7-a73731726bec None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.686205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8404519-ba11-4aee-b7d4-8b8fe8f93ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.686832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8404519-ba11-4aee-b7d4-8b8fe8f93ffc None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.687111 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8404519-ba11-4aee-b7d4-8b8fe8f93ffc None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.687383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8404519-ba11-4aee-b7d4-8b8fe8f93ffc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.688419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dfc203-f4a4-443d-ba53-93cf9be28a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.689053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfc203-f4a4-443d-ba53-93cf9be28a21 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.689340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfc203-f4a4-443d-ba53-93cf9be28a21 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.689613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dfc203-f4a4-443d-ba53-93cf9be28a21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.697258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfc203-f4a4-443d-ba53-93cf9be28a21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.698520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8404519-ba11-4aee-b7d4-8b8fe8f93ffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.698729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dfc203-f4a4-443d-ba53-93cf9be28a21 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.699978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8404519-ba11-4aee-b7d4-8b8fe8f93ffc None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-16dfc203-f4a4-443d-ba53-93cf9be28a21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:28.710596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:28.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:28.712453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:28.712453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:28.712453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:28.712453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:28.712453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:28.712453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:28.712453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:28.712453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:28.712453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 275/568] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:28.713052 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09278d-e10d-493e-9632-7235a23733b0 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.713270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09278d-e10d-493e-9632-7235a23733b0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.713537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09278d-e10d-493e-9632-7235a23733b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-e8404519-ba11-4aee-b7d4-8b8fe8f93ffc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:28.716296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:28.717392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:28.718487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:28.718487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:28.718487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:28.724291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 294/569] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:28.724291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8404519-ba11-4aee-b7d4-8b8fe8f93ffc None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.733524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1e09278d-e10d-493e-9632-7235a23733b0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:28.734747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1e09278d-e10d-493e-9632-7235a23733b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:28.800153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 276/570] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:28.801017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09278d-e10d-493e-9632-7235a23733b0 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.821199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8404519-ba11-4aee-b7d4-8b8fe8f93ffc None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.822091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.831756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:28.855167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14555b-ea9e-4ed2-bf41-3a40f7c00baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.856095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14555b-ea9e-4ed2-bf41-3a40f7c00baf None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.856423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14555b-ea9e-4ed2-bf41-3a40f7c00baf None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.856688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b14555b-ea9e-4ed2-bf41-3a40f7c00baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.867329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14555b-ea9e-4ed2-bf41-3a40f7c00baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:28.868813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b14555b-ea9e-4ed2-bf41-3a40f7c00baf None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-9b14555b-ea9e-4ed2-bf41-3a40f7c00baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:28.883248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:28.884232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:28.885214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:28.885214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:28.885214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:28.885214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 295/571] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:28.885214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14555b-ea9e-4ed2-bf41-3a40f7c00baf None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.908630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e09278d-e10d-493e-9632-7235a23733b0 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:28.945726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7bd6e-db30-4259-8d0c-fa67a83871e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:28.946609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7bd6e-db30-4259-8d0c-fa67a83871e3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:28.946609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7bd6e-db30-4259-8d0c-fa67a83871e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:28.946900 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7bd6e-db30-4259-8d0c-fa67a83871e3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:28.957235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7bd6e-db30-4259-8d0c-fa67a83871e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-c5a7bd6e-db30-4259-8d0c-fa67a83871e3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:28.962802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:28.963985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:28.965022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:28.968712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 277/572] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:28.969561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7bd6e-db30-4259-8d0c-fa67a83871e3 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:28.999082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b14555b-ea9e-4ed2-bf41-3a40f7c00baf None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.034329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cae3da-9645-4179-b49d-88851267e323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.034939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cae3da-9645-4179-b49d-88851267e323 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.035222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cae3da-9645-4179-b49d-88851267e323 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.035500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cae3da-9645-4179-b49d-88851267e323 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.036271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cae3da-9645-4179-b49d-88851267e323 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:29.036588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cae3da-9645-4179-b49d-88851267e323 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.038029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cae3da-9645-4179-b49d-88851267e323 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.049976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 296/573] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:29.050849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cae3da-9645-4179-b49d-88851267e323 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.058132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.079205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.081595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7bd6e-db30-4259-8d0c-fa67a83871e3 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.115650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec32af6-ebff-4461-b682-1a03e0d2e071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.116253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec32af6-ebff-4461-b682-1a03e0d2e071 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.116533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec32af6-ebff-4461-b682-1a03e0d2e071 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.116810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec32af6-ebff-4461-b682-1a03e0d2e071 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.117460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec32af6-ebff-4461-b682-1a03e0d2e071 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:29.117768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec32af6-ebff-4461-b682-1a03e0d2e071 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.119135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec32af6-ebff-4461-b682-1a03e0d2e071 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.130686 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 278/574] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:29.131482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec32af6-ebff-4461-b682-1a03e0d2e071 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.153368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cae3da-9645-4179-b49d-88851267e323 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.186923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fce5a-48bb-4c88-a5a6-68d9e95cbd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.187544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fce5a-48bb-4c88-a5a6-68d9e95cbd47 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.187845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fce5a-48bb-4c88-a5a6-68d9e95cbd47 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.188115 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821fce5a-48bb-4c88-a5a6-68d9e95cbd47 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.188758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fce5a-48bb-4c88-a5a6-68d9e95cbd47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:29.189065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fce5a-48bb-4c88-a5a6-68d9e95cbd47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.190424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821fce5a-48bb-4c88-a5a6-68d9e95cbd47 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.201742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 297/575] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:29.202527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fce5a-48bb-4c88-a5a6-68d9e95cbd47 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.228436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec32af6-ebff-4461-b682-1a03e0d2e071 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.262557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6cd06-970f-4fa8-b996-6dd8a618a1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.263154 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6cd06-970f-4fa8-b996-6dd8a618a1ff None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.263437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6cd06-970f-4fa8-b996-6dd8a618a1ff None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.263741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6cd06-970f-4fa8-b996-6dd8a618a1ff None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.264403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6cd06-970f-4fa8-b996-6dd8a618a1ff None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:29.264709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6cd06-970f-4fa8-b996-6dd8a618a1ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.266082 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c6cd06-970f-4fa8-b996-6dd8a618a1ff None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.270925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.274598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 279/576] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:29.275365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6cd06-970f-4fa8-b996-6dd8a618a1ff None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.285338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.303102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821fce5a-48bb-4c88-a5a6-68d9e95cbd47 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.336550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550304-a478-4485-88e5-0f0edb05d10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.337151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550304-a478-4485-88e5-0f0edb05d10d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.337433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550304-a478-4485-88e5-0f0edb05d10d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.337705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550304-a478-4485-88e5-0f0edb05d10d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.338425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e550304-a478-4485-88e5-0f0edb05d10d None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=590ac0c1da06460a8d32852f9c2e3609) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:29.338735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e550304-a478-4485-88e5-0f0edb05d10d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.340206 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e550304-a478-4485-88e5-0f0edb05d10d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.345504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 298/577] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/role_assignments?user.id=590ac0c1da06460a8d32852f9c2e3609&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:29.346177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550304-a478-4485-88e5-0f0edb05d10d None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.385837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c6cd06-970f-4fa8-b996-6dd8a618a1ff None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.424103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365f84f-1f9e-4e98-aa95-d35412914073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.424751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365f84f-1f9e-4e98-aa95-d35412914073 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.425042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365f84f-1f9e-4e98-aa95-d35412914073 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.425312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365f84f-1f9e-4e98-aa95-d35412914073 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.437253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365f84f-1f9e-4e98-aa95-d35412914073 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-a365f84f-1f9e-4e98-aa95-d35412914073 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:29.442777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:29.443978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 280/578] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:29.444812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365f84f-1f9e-4e98-aa95-d35412914073 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.467622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550304-a478-4485-88e5-0f0edb05d10d None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.505241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d531513-209c-44ae-9557-4737eacb579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.506215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531513-209c-44ae-9557-4737eacb579b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.506672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531513-209c-44ae-9557-4737eacb579b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.507122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531513-209c-44ae-9557-4737eacb579b None admin] PATH_INFO: `/v3/users/glance` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.511103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.516084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d531513-209c-44ae-9557-4737eacb579b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.517517 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d531513-209c-44ae-9557-4737eacb579b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-7d531513-209c-44ae-9557-4737eacb579b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:29.530434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:29.537270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 299/579] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:29.538495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d531513-209c-44ae-9557-4737eacb579b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.546937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.564565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365f84f-1f9e-4e98-aa95-d35412914073 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.608550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e62c2d-dc13-4b10-971a-bdad9ea167c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.609186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62c2d-dc13-4b10-971a-bdad9ea167c5 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.609476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62c2d-dc13-4b10-971a-bdad9ea167c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.609743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e62c2d-dc13-4b10-971a-bdad9ea167c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.616994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e62c2d-dc13-4b10-971a-bdad9ea167c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.618425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e62c2d-dc13-4b10-971a-bdad9ea167c5 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-c8e62c2d-dc13-4b10-971a-bdad9ea167c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:29.634422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:29.635360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 281/580] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:29.636926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e62c2d-dc13-4b10-971a-bdad9ea167c5 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.657211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d531513-209c-44ae-9557-4737eacb579b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.692292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436419d4-c2ac-4e4a-b9cc-bc07478942b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.693096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436419d4-c2ac-4e4a-b9cc-bc07478942b9 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.693378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436419d4-c2ac-4e4a-b9cc-bc07478942b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.693799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436419d4-c2ac-4e4a-b9cc-bc07478942b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.704996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436419d4-c2ac-4e4a-b9cc-bc07478942b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.706583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436419d4-c2ac-4e4a-b9cc-bc07478942b9 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-436419d4-c2ac-4e4a-b9cc-bc07478942b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:29.721715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:29.722698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:29.724149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:29.724149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:29.724149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:29.724149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 300/581] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:29.724384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436419d4-c2ac-4e4a-b9cc-bc07478942b9 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.743898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e62c2d-dc13-4b10-971a-bdad9ea167c5 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.763666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.778743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd087fb0-063c-4e66-a601-8cd65c471bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.779346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd087fb0-063c-4e66-a601-8cd65c471bd9 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.779713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd087fb0-063c-4e66-a601-8cd65c471bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.779989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd087fb0-063c-4e66-a601-8cd65c471bd9 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.780652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd087fb0-063c-4e66-a601-8cd65c471bd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:29.780959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd087fb0-063c-4e66-a601-8cd65c471bd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.782321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd087fb0-063c-4e66-a601-8cd65c471bd9 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.784754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:29.791832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 282/582] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:29.792825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd087fb0-063c-4e66-a601-8cd65c471bd9 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.840133 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436419d4-c2ac-4e4a-b9cc-bc07478942b9 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.872629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbaeaa-2cb2-4f50-a369-a197b6fb5549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.873232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbaeaa-2cb2-4f50-a369-a197b6fb5549 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.873514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbaeaa-2cb2-4f50-a369-a197b6fb5549 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.873783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bbaeaa-2cb2-4f50-a369-a197b6fb5549 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.874540 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbaeaa-2cb2-4f50-a369-a197b6fb5549 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:29.874843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbaeaa-2cb2-4f50-a369-a197b6fb5549 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.876304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bbaeaa-2cb2-4f50-a369-a197b6fb5549 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.893014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 301/583] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:29.893820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbaeaa-2cb2-4f50-a369-a197b6fb5549 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.903759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd087fb0-063c-4e66-a601-8cd65c471bd9 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:29.940708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597470d-ccf0-4ead-8e08-cc2b2c848d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:29.941311 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597470d-ccf0-4ead-8e08-cc2b2c848d80 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:29.941667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597470d-ccf0-4ead-8e08-cc2b2c848d80 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:29.941939 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7597470d-ccf0-4ead-8e08-cc2b2c848d80 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:29.942738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597470d-ccf0-4ead-8e08-cc2b2c848d80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:29.943064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597470d-ccf0-4ead-8e08-cc2b2c848d80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:29.944660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7597470d-ccf0-4ead-8e08-cc2b2c848d80 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:29.962595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 283/584] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:29.962595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597470d-ccf0-4ead-8e08-cc2b2c848d80 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:29.997156 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bbaeaa-2cb2-4f50-a369-a197b6fb5549 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.008827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:30.014121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:30.033154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53717c8-b122-4fa5-a9c9-e0d6ae2ea4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.033757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53717c8-b122-4fa5-a9c9-e0d6ae2ea4d4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.034041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53717c8-b122-4fa5-a9c9-e0d6ae2ea4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.034315 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53717c8-b122-4fa5-a9c9-e0d6ae2ea4d4 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.034958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53717c8-b122-4fa5-a9c9-e0d6ae2ea4d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:30.035284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53717c8-b122-4fa5-a9c9-e0d6ae2ea4d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.037218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53717c8-b122-4fa5-a9c9-e0d6ae2ea4d4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.048351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 302/585] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:30.051355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53717c8-b122-4fa5-a9c9-e0d6ae2ea4d4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.073327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7597470d-ccf0-4ead-8e08-cc2b2c848d80 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.109518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af3b8f-4277-4a5c-a5c9-bc236572d737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.110077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af3b8f-4277-4a5c-a5c9-bc236572d737 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.110359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af3b8f-4277-4a5c-a5c9-bc236572d737 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.110640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af3b8f-4277-4a5c-a5c9-bc236572d737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.121827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af3b8f-4277-4a5c-a5c9-bc236572d737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.123316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af3b8f-4277-4a5c-a5c9-bc236572d737 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-a3af3b8f-4277-4a5c-a5c9-bc236572d737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:30.138135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:30.139085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:30.140019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:30.140019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:30.140019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:30.144027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 284/586] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:30.145182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af3b8f-4277-4a5c-a5c9-bc236572d737 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.154146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53717c8-b122-4fa5-a9c9-e0d6ae2ea4d4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.189734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c367ee-2bec-4d28-a3de-efa1fc083800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.190268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c367ee-2bec-4d28-a3de-efa1fc083800 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.190549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c367ee-2bec-4d28-a3de-efa1fc083800 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.190827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c367ee-2bec-4d28-a3de-efa1fc083800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.202235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c367ee-2bec-4d28-a3de-efa1fc083800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.203705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c367ee-2bec-4d28-a3de-efa1fc083800 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-92c367ee-2bec-4d28-a3de-efa1fc083800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:30.219774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:30.220830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:30.221715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:30.221715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:30.221715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:30.221715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 303/587] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:30.221715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c367ee-2bec-4d28-a3de-efa1fc083800 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.250006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:30.251420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:30.257104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af3b8f-4277-4a5c-a5c9-bc236572d737 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.293230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07c247-a6bb-4d22-9719-aa29fcc67748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.293886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07c247-a6bb-4d22-9719-aa29fcc67748 None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.294166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07c247-a6bb-4d22-9719-aa29fcc67748 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.294440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad07c247-a6bb-4d22-9719-aa29fcc67748 None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/e05901861bc34c2398ec600150296657/roles/65669c196efb4b919bf9ee6dd9b1f623` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.310273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07c247-a6bb-4d22-9719-aa29fcc67748 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=e05901861bc34c2398ec600150296657, role_id=65669c196efb4b919bf9ee6dd9b1f623)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.311728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad07c247-a6bb-4d22-9719-aa29fcc67748 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.323815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c367ee-2bec-4d28-a3de-efa1fc083800 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.357259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f59ed-6c7c-4ef1-9502-a3f7bfa03eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.357902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f59ed-6c7c-4ef1-9502-a3f7bfa03eb2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.358181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f59ed-6c7c-4ef1-9502-a3f7bfa03eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.358451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723f59ed-6c7c-4ef1-9502-a3f7bfa03eb2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.365270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f59ed-6c7c-4ef1-9502-a3f7bfa03eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.366640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723f59ed-6c7c-4ef1-9502-a3f7bfa03eb2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-723f59ed-6c7c-4ef1-9502-a3f7bfa03eb2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:30.377962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:30.379630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:30.380646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 304/588] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:30.381223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f59ed-6c7c-4ef1-9502-a3f7bfa03eb2 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.391858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 285/589] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:30 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/e05901861bc34c2398ec600150296657/roles/65669c196efb4b919bf9ee6dd9b1f623 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:30.393312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07c247-a6bb-4d22-9719-aa29fcc67748 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.504890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:30.521242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723f59ed-6c7c-4ef1-9502-a3f7bfa03eb2 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.538355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad07c247-a6bb-4d22-9719-aa29fcc67748 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.579114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0523999-4965-430d-8d2e-e7ccd35f5c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.579753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0523999-4965-430d-8d2e-e7ccd35f5c2c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.580031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0523999-4965-430d-8d2e-e7ccd35f5c2c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.580299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0523999-4965-430d-8d2e-e7ccd35f5c2c None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.580950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0523999-4965-430d-8d2e-e7ccd35f5c2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:30.581247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0523999-4965-430d-8d2e-e7ccd35f5c2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.582686 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0523999-4965-430d-8d2e-e7ccd35f5c2c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.598832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954ae0-dfdd-433e-a14a-4a3edeef34f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.599719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954ae0-dfdd-433e-a14a-4a3edeef34f0 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.600162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954ae0-dfdd-433e-a14a-4a3edeef34f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.600589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68954ae0-dfdd-433e-a14a-4a3edeef34f0 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.600941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 305/590] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:30.601552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954ae0-dfdd-433e-a14a-4a3edeef34f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:30.601791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0523999-4965-430d-8d2e-e7ccd35f5c2c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.602231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954ae0-dfdd-433e-a14a-4a3edeef34f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.603771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68954ae0-dfdd-433e-a14a-4a3edeef34f0 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.620576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 286/591] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:30.621915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954ae0-dfdd-433e-a14a-4a3edeef34f0 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.626803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:30.710544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0523999-4965-430d-8d2e-e7ccd35f5c2c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.746489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592fbf4-d7a1-4263-97b0-f4c36b7d75ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.747253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592fbf4-d7a1-4263-97b0-f4c36b7d75ec None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.747703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592fbf4-d7a1-4263-97b0-f4c36b7d75ec None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.747949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68954ae0-dfdd-433e-a14a-4a3edeef34f0 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.748162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6592fbf4-d7a1-4263-97b0-f4c36b7d75ec None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.748999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592fbf4-d7a1-4263-97b0-f4c36b7d75ec None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:30.749407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592fbf4-d7a1-4263-97b0-f4c36b7d75ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.751527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6592fbf4-d7a1-4263-97b0-f4c36b7d75ec None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.774253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 306/592] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:30.775281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592fbf4-d7a1-4263-97b0-f4c36b7d75ec None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.784488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:30.792007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d403d-ea18-4b48-bf75-2077ec5c1bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.792963 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d403d-ea18-4b48-bf75-2077ec5c1bab None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.793384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d403d-ea18-4b48-bf75-2077ec5c1bab None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.793831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d403d-ea18-4b48-bf75-2077ec5c1bab None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.803834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d403d-ea18-4b48-bf75-2077ec5c1bab None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.805439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d403d-ea18-4b48-bf75-2077ec5c1bab None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-ba0d403d-ea18-4b48-bf75-2077ec5c1bab None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:30.819718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:30.820749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:30.821674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:30.823849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 287/593] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:30.824763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d403d-ea18-4b48-bf75-2077ec5c1bab None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.889734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6592fbf4-d7a1-4263-97b0-f4c36b7d75ec None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.893862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:30.928806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c592f35-e986-4238-8da1-84c4bf7f231a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.929529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592f35-e986-4238-8da1-84c4bf7f231a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.929958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592f35-e986-4238-8da1-84c4bf7f231a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.930211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c592f35-e986-4238-8da1-84c4bf7f231a None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.937562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d403d-ea18-4b48-bf75-2077ec5c1bab None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:30.938029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c592f35-e986-4238-8da1-84c4bf7f231a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.939558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c592f35-e986-4238-8da1-84c4bf7f231a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-6c592f35-e986-4238-8da1-84c4bf7f231a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:30.951360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:30.952302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:30.953177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:30.953177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:30.953177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:30.953177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:30.953177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:30.953177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:30.953177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:30.953177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:30.957423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 307/594] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:30.958351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c592f35-e986-4238-8da1-84c4bf7f231a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:30.978172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df5272-c688-40ce-b891-8e98b146dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:30.979084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df5272-c688-40ce-b891-8e98b146dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:30.979601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df5272-c688-40ce-b891-8e98b146dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:30.980042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df5272-c688-40ce-b891-8e98b146dcb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:30.992631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df5272-c688-40ce-b891-8e98b146dcb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:30.994899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85df5272-c688-40ce-b891-8e98b146dcb3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-85df5272-c688-40ce-b891-8e98b146dcb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:31.009711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:31.010699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:31.011635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:31.011635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:31.011635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:31.013894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 288/595] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:31.014842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df5272-c688-40ce-b891-8e98b146dcb3 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.039692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.076103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c592f35-e986-4238-8da1-84c4bf7f231a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.112394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527592df-1b4b-4bfa-8de0-d9c24e87cef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.113126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527592df-1b4b-4bfa-8de0-d9c24e87cef0 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.114012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527592df-1b4b-4bfa-8de0-d9c24e87cef0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.114364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527592df-1b4b-4bfa-8de0-d9c24e87cef0 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.115429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527592df-1b4b-4bfa-8de0-d9c24e87cef0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:31.115754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527592df-1b4b-4bfa-8de0-d9c24e87cef0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.117322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527592df-1b4b-4bfa-8de0-d9c24e87cef0 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.135603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df5272-c688-40ce-b891-8e98b146dcb3 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.140719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 308/596] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Oct 4 08:33:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:31.141662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527592df-1b4b-4bfa-8de0-d9c24e87cef0 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.155736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.176926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d26b0-ea44-4b5b-80e1-d9a385bfecab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.177852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d26b0-ea44-4b5b-80e1-d9a385bfecab None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.178306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d26b0-ea44-4b5b-80e1-d9a385bfecab None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.178749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d26b0-ea44-4b5b-80e1-d9a385bfecab None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.179820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d26b0-ea44-4b5b-80e1-d9a385bfecab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:31.180304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d26b0-ea44-4b5b-80e1-d9a385bfecab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.182707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d26b0-ea44-4b5b-80e1-d9a385bfecab None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.197152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 289/597] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:31.198213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d26b0-ea44-4b5b-80e1-d9a385bfecab None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.256992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527592df-1b4b-4bfa-8de0-d9c24e87cef0 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.283411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.295759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501f8b1-aa39-40f7-966a-b85ff68c6775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.296454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501f8b1-aa39-40f7-966a-b85ff68c6775 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.296808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501f8b1-aa39-40f7-966a-b85ff68c6775 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.297504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501f8b1-aa39-40f7-966a-b85ff68c6775 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.298002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501f8b1-aa39-40f7-966a-b85ff68c6775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:31.298374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501f8b1-aa39-40f7-966a-b85ff68c6775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.299846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501f8b1-aa39-40f7-966a-b85ff68c6775 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.311696 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d26b0-ea44-4b5b-80e1-d9a385bfecab None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.318605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 309/598] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:31.319920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501f8b1-aa39-40f7-966a-b85ff68c6775 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.360504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cdb25-2bc1-41e2-a51b-a5e722984c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.362329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cdb25-2bc1-41e2-a51b-a5e722984c5b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.362833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cdb25-2bc1-41e2-a51b-a5e722984c5b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.363333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923cdb25-2bc1-41e2-a51b-a5e722984c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.376043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cdb25-2bc1-41e2-a51b-a5e722984c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.378128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923cdb25-2bc1-41e2-a51b-a5e722984c5b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-923cdb25-2bc1-41e2-a51b-a5e722984c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:31.396693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:31.398068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:31.398977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:31.398977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:31.398977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:31.400988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 290/599] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:31.402097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cdb25-2bc1-41e2-a51b-a5e722984c5b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.438509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501f8b1-aa39-40f7-966a-b85ff68c6775 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.439888 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.475061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b3125-1fcf-4d3e-815d-ed31860d9fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.479596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b3125-1fcf-4d3e-815d-ed31860d9fca None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.479596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b3125-1fcf-4d3e-815d-ed31860d9fca None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.479596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b3125-1fcf-4d3e-815d-ed31860d9fca None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/4289134c7df04f96a5c4661165105109/roles/65669c196efb4b919bf9ee6dd9b1f623` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.491871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b3125-1fcf-4d3e-815d-ed31860d9fca None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=4289134c7df04f96a5c4661165105109, role_id=65669c196efb4b919bf9ee6dd9b1f623)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.493537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b3125-1fcf-4d3e-815d-ed31860d9fca None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.521391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923cdb25-2bc1-41e2-a51b-a5e722984c5b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.556534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d299024-6f14-4c1c-8fe3-1342dce55ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.557162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d299024-6f14-4c1c-8fe3-1342dce55ee8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.557439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d299024-6f14-4c1c-8fe3-1342dce55ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.557711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d299024-6f14-4c1c-8fe3-1342dce55ee8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.564248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d299024-6f14-4c1c-8fe3-1342dce55ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.565673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d299024-6f14-4c1c-8fe3-1342dce55ee8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-7d299024-6f14-4c1c-8fe3-1342dce55ee8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:31.578379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:31.579476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:31.580455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:31.580455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:31.580455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:31.580455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:31.580455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:31.580455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:31.580455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:31.580455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:31.580455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 291/600] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:31.580929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d299024-6f14-4c1c-8fe3-1342dce55ee8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.584019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 310/601] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:31 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/4289134c7df04f96a5c4661165105109/roles/65669c196efb4b919bf9ee6dd9b1f623 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:31.585282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7abe-8296-45fa-9f2a-4f10f44e10cb None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.585587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7abe-8296-45fa-9f2a-4f10f44e10cb None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.586009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d7abe-8296-45fa-9f2a-4f10f44e10cb None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.592879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 311/602] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:31.602122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315d95-75b0-4a72-9b9a-729f39ab384d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.602122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315d95-75b0-4a72-9b9a-729f39ab384d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.602122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a315d95-75b0-4a72-9b9a-729f39ab384d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.622010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9a315d95-75b0-4a72-9b9a-729f39ab384d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:31.623768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9a315d95-75b0-4a72-9b9a-729f39ab384d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:31.663554 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.710810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.726982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d299024-6f14-4c1c-8fe3-1342dce55ee8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.731868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 312/603] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:31.732884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a315d95-75b0-4a72-9b9a-729f39ab384d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.772319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3d227-dd13-4fdf-ab8b-f0bdee5152ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.773257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3d227-dd13-4fdf-ab8b-f0bdee5152ad None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.773679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3d227-dd13-4fdf-ab8b-f0bdee5152ad None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.774093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3d227-dd13-4fdf-ab8b-f0bdee5152ad None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.775484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3d227-dd13-4fdf-ab8b-f0bdee5152ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:31.775976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3d227-dd13-4fdf-ab8b-f0bdee5152ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.777981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d3d227-dd13-4fdf-ab8b-f0bdee5152ad None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.793549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 292/604] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:31.801427 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3d227-dd13-4fdf-ab8b-f0bdee5152ad None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.866531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a315d95-75b0-4a72-9b9a-729f39ab384d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.901899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c1f6-a5c2-47c2-8018-8a51c1f5699f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.902641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c1f6-a5c2-47c2-8018-8a51c1f5699f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.903025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c1f6-a5c2-47c2-8018-8a51c1f5699f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.903399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd29c1f6-a5c2-47c2-8018-8a51c1f5699f None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.904222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c1f6-a5c2-47c2-8018-8a51c1f5699f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:31.904635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c1f6-a5c2-47c2-8018-8a51c1f5699f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.906180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd29c1f6-a5c2-47c2-8018-8a51c1f5699f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.918690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d3d227-dd13-4fdf-ab8b-f0bdee5152ad None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:31.926561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 313/605] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:31.927643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c1f6-a5c2-47c2-8018-8a51c1f5699f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:31.964503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f878b-fcf3-47ca-bb6e-bba461887523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:31.965369 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f878b-fcf3-47ca-bb6e-bba461887523 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:31.965789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f878b-fcf3-47ca-bb6e-bba461887523 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:31.966199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7f878b-fcf3-47ca-bb6e-bba461887523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:31.974022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f878b-fcf3-47ca-bb6e-bba461887523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:31.975776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7f878b-fcf3-47ca-bb6e-bba461887523 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:31.989094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-5f7f878b-fcf3-47ca-bb6e-bba461887523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:31.989303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:31.990146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:31.991176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:31.991176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:31.991176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:31.991176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:31.991176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:31.991176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:31.991176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:31.991176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:31.993421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 293/606] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:31.998899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f878b-fcf3-47ca-bb6e-bba461887523 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.012120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.107998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd29c1f6-a5c2-47c2-8018-8a51c1f5699f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.119770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7f878b-fcf3-47ca-bb6e-bba461887523 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.155101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9bb9b-673b-4cdb-b518-c66ecc6f78e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.155922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9bb9b-673b-4cdb-b518-c66ecc6f78e9 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.156211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9bb9b-673b-4cdb-b518-c66ecc6f78e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.156570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d9bb9b-673b-4cdb-b518-c66ecc6f78e9 None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/6f4df3626bdb4e3a88ce27eaabf4ca1f/roles/65669c196efb4b919bf9ee6dd9b1f623` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.158801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9071d9-3bd7-4f83-8373-a36cd810dfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.159585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9071d9-3bd7-4f83-8373-a36cd810dfe5 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.160000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9071d9-3bd7-4f83-8373-a36cd810dfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.160969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9071d9-3bd7-4f83-8373-a36cd810dfe5 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.161801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9071d9-3bd7-4f83-8373-a36cd810dfe5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:32.162269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9071d9-3bd7-4f83-8373-a36cd810dfe5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.163920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9071d9-3bd7-4f83-8373-a36cd810dfe5 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.173662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9bb9b-673b-4cdb-b518-c66ecc6f78e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=6f4df3626bdb4e3a88ce27eaabf4ca1f, role_id=65669c196efb4b919bf9ee6dd9b1f623)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.175653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d9bb9b-673b-4cdb-b518-c66ecc6f78e9 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.178666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 294/607] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:32.179701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9071d9-3bd7-4f83-8373-a36cd810dfe5 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.249739 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.288319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9071d9-3bd7-4f83-8373-a36cd810dfe5 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.299825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 314/608] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:31 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/6f4df3626bdb4e3a88ce27eaabf4ca1f/roles/65669c196efb4b919bf9ee6dd9b1f623 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:32.300705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9bb9b-673b-4cdb-b518-c66ecc6f78e9 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.336213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9b8cf-5a98-4508-95cd-73da2cbb28e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.337225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9b8cf-5a98-4508-95cd-73da2cbb28e1 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.337959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9b8cf-5a98-4508-95cd-73da2cbb28e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.338524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9b8cf-5a98-4508-95cd-73da2cbb28e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.355905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9b8cf-5a98-4508-95cd-73da2cbb28e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-5fd9b8cf-5a98-4508-95cd-73da2cbb28e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:32.364749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:32.366001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:32.366932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:32.370125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 295/609] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:32.377524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9b8cf-5a98-4508-95cd-73da2cbb28e1 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.450217 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.509008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9b8cf-5a98-4508-95cd-73da2cbb28e1 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.511069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d9bb9b-673b-4cdb-b518-c66ecc6f78e9 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.542492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.552423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f17e2-88ad-49f5-8839-9e35d80ac54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.553262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f17e2-88ad-49f5-8839-9e35d80ac54d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.553632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f17e2-88ad-49f5-8839-9e35d80ac54d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.553915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029f17e2-88ad-49f5-8839-9e35d80ac54d None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.554767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f17e2-88ad-49f5-8839-9e35d80ac54d None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:32.555086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f17e2-88ad-49f5-8839-9e35d80ac54d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.556825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029f17e2-88ad-49f5-8839-9e35d80ac54d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.557221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58480c42-342b-48ab-8508-2e02e69fc8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.561298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58480c42-342b-48ab-8508-2e02e69fc8ac None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.561298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58480c42-342b-48ab-8508-2e02e69fc8ac None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.561298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58480c42-342b-48ab-8508-2e02e69fc8ac None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/a269743c34bc48edaab5c0e3e78074c5/roles/65669c196efb4b919bf9ee6dd9b1f623` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.567749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 296/610] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:32.574144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f17e2-88ad-49f5-8839-9e35d80ac54d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.583428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58480c42-342b-48ab-8508-2e02e69fc8ac None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=a269743c34bc48edaab5c0e3e78074c5, role_id=65669c196efb4b919bf9ee6dd9b1f623)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.585422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58480c42-342b-48ab-8508-2e02e69fc8ac None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.686356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 315/611] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:32 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/a269743c34bc48edaab5c0e3e78074c5/roles/65669c196efb4b919bf9ee6dd9b1f623 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:32.714371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029f17e2-88ad-49f5-8839-9e35d80ac54d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.753299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d2113-2175-44ba-b312-e4423d6d335e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.754694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d2113-2175-44ba-b312-e4423d6d335e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.755067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d2113-2175-44ba-b312-e4423d6d335e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.755432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d2113-2175-44ba-b312-e4423d6d335e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.762643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee28f-e6ee-4ed1-9e2a-edc7cd57d465 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.762992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee28f-e6ee-4ed1-9e2a-edc7cd57d465 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.763186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dee28f-e6ee-4ed1-9e2a-edc7cd57d465 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.764819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 316/612] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:32.771320 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cdd52-ec3d-440d-a9b1-30584ad833c2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.772440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d2113-2175-44ba-b312-e4423d6d335e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.773994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d2113-2175-44ba-b312-e4423d6d335e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.775688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cdd52-ec3d-440d-a9b1-30584ad833c2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.776046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60cdd52-ec3d-440d-a9b1-30584ad833c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-4c2d2113-2175-44ba-b312-e4423d6d335e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:32.792217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:32.794409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:32.796444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:32.796444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:32.796444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:32.796444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 297/613] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:32.803635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d2113-2175-44ba-b312-e4423d6d335e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:32.824663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d60cdd52-ec3d-440d-a9b1-30584ad833c2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:32.825890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d60cdd52-ec3d-440d-a9b1-30584ad833c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:32.855337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:32.922221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d2113-2175-44ba-b312-e4423d6d335e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:32.956316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 317/614] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:32.963904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ab5c-3162-4d42-a0e3-9cacb815fb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:32.964562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ab5c-3162-4d42-a0e3-9cacb815fb73 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:32.964782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ab5c-3162-4d42-a0e3-9cacb815fb73 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:32.965050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ab5c-3162-4d42-a0e3-9cacb815fb73 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:32.965689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50ab5c-3162-4d42-a0e3-9cacb815fb73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:32.965987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50ab5c-3162-4d42-a0e3-9cacb815fb73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:32.967339 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50ab5c-3162-4d42-a0e3-9cacb815fb73 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:32.984352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 298/615] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:32.990504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cdd52-ec3d-440d-a9b1-30584ad833c2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.070178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.129537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60cdd52-ec3d-440d-a9b1-30584ad833c2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.174957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271773d8-2824-4bd9-83dd-8b4b9d9d2a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.176484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271773d8-2824-4bd9-83dd-8b4b9d9d2a3d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.176864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271773d8-2824-4bd9-83dd-8b4b9d9d2a3d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.177232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271773d8-2824-4bd9-83dd-8b4b9d9d2a3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.184793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271773d8-2824-4bd9-83dd-8b4b9d9d2a3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.186327 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271773d8-2824-4bd9-83dd-8b4b9d9d2a3d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-271773d8-2824-4bd9-83dd-8b4b9d9d2a3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:33.198783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:33.199949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:33.201123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:33.203262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 318/616] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:33.209075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ab5c-3162-4d42-a0e3-9cacb815fb73 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.322372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271773d8-2824-4bd9-83dd-8b4b9d9d2a3d None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.400807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ab5c-3162-4d42-a0e3-9cacb815fb73 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.405568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.465548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71870-ee4e-45b8-a2c5-4f74da263717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.466152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71870-ee4e-45b8-a2c5-4f74da263717 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.466435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71870-ee4e-45b8-a2c5-4f74da263717 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.466708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf71870-ee4e-45b8-a2c5-4f74da263717 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.470185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71870-ee4e-45b8-a2c5-4f74da263717 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:33.470503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71870-ee4e-45b8-a2c5-4f74da263717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.471962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf71870-ee4e-45b8-a2c5-4f74da263717 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.494741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271773d8-2824-4bd9-83dd-8b4b9d9d2a3d None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.510107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 299/617] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:33.516758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71870-ee4e-45b8-a2c5-4f74da263717 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.522032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.546583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c6995-9452-4fc7-851c-529206f3cd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.547214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c6995-9452-4fc7-851c-529206f3cd80 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.547496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c6995-9452-4fc7-851c-529206f3cd80 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.547843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514c6995-9452-4fc7-851c-529206f3cd80 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.561569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514c6995-9452-4fc7-851c-529206f3cd80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-514c6995-9452-4fc7-851c-529206f3cd80 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:33.567019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:33.568000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:33.568981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 319/618] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:33.577138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c6995-9452-4fc7-851c-529206f3cd80 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.709612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf71870-ee4e-45b8-a2c5-4f74da263717 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.721667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514c6995-9452-4fc7-851c-529206f3cd80 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.759750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b2da0-21bf-44b7-937b-894a15dd091a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.760529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b2da0-21bf-44b7-937b-894a15dd091a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.760812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b2da0-21bf-44b7-937b-894a15dd091a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.761409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b2da0-21bf-44b7-937b-894a15dd091a None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.762093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b2da0-21bf-44b7-937b-894a15dd091a None admin] RBAC: Adding query filter params (name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:33.762401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b2da0-21bf-44b7-937b-894a15dd091a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.763798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b2da0-21bf-44b7-937b-894a15dd091a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.773391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 320/619] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:33.778555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b2da0-21bf-44b7-937b-894a15dd091a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.788224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02f34-c1f7-485d-88e4-1f70b4615cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:33.788864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02f34-c1f7-485d-88e4-1f70b4615cda None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:33.789144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02f34-c1f7-485d-88e4-1f70b4615cda None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:33.789417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d02f34-c1f7-485d-88e4-1f70b4615cda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:33.812703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d02f34-c1f7-485d-88e4-1f70b4615cda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:33.814267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d02f34-c1f7-485d-88e4-1f70b4615cda None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:33.827989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-a8d02f34-c1f7-485d-88e4-1f70b4615cda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:33.843724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:33.844744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:33.845654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:33.845654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:33.845654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:33.845654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 300/620] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:33.851902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02f34-c1f7-485d-88e4-1f70b4615cda None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:33.877468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:33.974857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d02f34-c1f7-485d-88e4-1f70b4615cda None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:33.985417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b2da0-21bf-44b7-937b-894a15dd091a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.016132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533ef0-350c-4fd3-bf1c-f74d9d07cd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.017553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533ef0-350c-4fd3-bf1c-f74d9d07cd5a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.017832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533ef0-350c-4fd3-bf1c-f74d9d07cd5a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.018109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09533ef0-350c-4fd3-bf1c-f74d9d07cd5a None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.018758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533ef0-350c-4fd3-bf1c-f74d9d07cd5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:34.019062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533ef0-350c-4fd3-bf1c-f74d9d07cd5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.023186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09533ef0-350c-4fd3-bf1c-f74d9d07cd5a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.047831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 301/621] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:34.051734 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533ef0-350c-4fd3-bf1c-f74d9d07cd5a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.057212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bab008-0c74-4b09-8776-9c50cffcc636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.060180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bab008-0c74-4b09-8776-9c50cffcc636 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.060752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bab008-0c74-4b09-8776-9c50cffcc636 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.062109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bab008-0c74-4b09-8776-9c50cffcc636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.084116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bab008-0c74-4b09-8776-9c50cffcc636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.088239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bab008-0c74-4b09-8776-9c50cffcc636 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-21bab008-0c74-4b09-8776-9c50cffcc636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:34.118570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:34.119629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:34.120523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:34.120523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:34.120523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:34.120523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 321/622] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:34.128405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bab008-0c74-4b09-8776-9c50cffcc636 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.166813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.191560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09533ef0-350c-4fd3-bf1c-f74d9d07cd5a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.237198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac935f1-bd50-4f28-9c00-d305f39e1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.237835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac935f1-bd50-4f28-9c00-d305f39e1c54 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.238111 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac935f1-bd50-4f28-9c00-d305f39e1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.238938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac935f1-bd50-4f28-9c00-d305f39e1c54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.246241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac935f1-bd50-4f28-9c00-d305f39e1c54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.247835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac935f1-bd50-4f28-9c00-d305f39e1c54 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-6ac935f1-bd50-4f28-9c00-d305f39e1c54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:34.259613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:34.260586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:34.261484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:34.261484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:34.261484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:34.261484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:34.261484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:34.261484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:34.261484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:34.261484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:34.261484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 302/623] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:34.262477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638f54-28b7-4790-8a14-884a68854fbe None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.262648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638f54-28b7-4790-8a14-884a68854fbe None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.263821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24638f54-28b7-4790-8a14-884a68854fbe None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.264458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 303/624] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:34.270432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24638f54-28b7-4790-8a14-884a68854fbe None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.283831 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.300643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bab008-0c74-4b09-8776-9c50cffcc636 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.348621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841ae9f-5d2f-4848-b4c6-57a9bc61a863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.349232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841ae9f-5d2f-4848-b4c6-57a9bc61a863 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.349472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841ae9f-5d2f-4848-b4c6-57a9bc61a863 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.349697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841ae9f-5d2f-4848-b4c6-57a9bc61a863 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.350347 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841ae9f-5d2f-4848-b4c6-57a9bc61a863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:34.350651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841ae9f-5d2f-4848-b4c6-57a9bc61a863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.352064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841ae9f-5d2f-4848-b4c6-57a9bc61a863 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.368353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 322/625] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:34.368353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b5ab-586e-4882-b70b-cc3973527a7a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.368353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b5ab-586e-4882-b70b-cc3973527a7a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.368353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c42b5ab-586e-4882-b70b-cc3973527a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.383834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-4c42b5ab-586e-4882-b70b-cc3973527a7a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:34.385010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4c42b5ab-586e-4882-b70b-cc3973527a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:34.403737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24638f54-28b7-4790-8a14-884a68854fbe None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.434997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.441165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9a178-003f-4cf9-9ea6-eefc743d1946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.442091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9a178-003f-4cf9-9ea6-eefc743d1946 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.442532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9a178-003f-4cf9-9ea6-eefc743d1946 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.448381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9a178-003f-4cf9-9ea6-eefc743d1946 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.448381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9a178-003f-4cf9-9ea6-eefc743d1946 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:34.448381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9a178-003f-4cf9-9ea6-eefc743d1946 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.448381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9a178-003f-4cf9-9ea6-eefc743d1946 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.463543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 323/626] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:34.463543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42b5ab-586e-4882-b70b-cc3973527a7a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.465768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 304/627] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:34.471642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9a178-003f-4cf9-9ea6-eefc743d1946 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.542671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.564984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c42b5ab-586e-4882-b70b-cc3973527a7a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.587718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9a178-003f-4cf9-9ea6-eefc743d1946 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.601109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229312-4223-4836-a7a1-32465f24e77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.601387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229312-4223-4836-a7a1-32465f24e77a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.601540 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229312-4223-4836-a7a1-32465f24e77a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.601820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca229312-4223-4836-a7a1-32465f24e77a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.609112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca229312-4223-4836-a7a1-32465f24e77a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.610557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca229312-4223-4836-a7a1-32465f24e77a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-ca229312-4223-4836-a7a1-32465f24e77a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:34.622726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:34.623723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:34.624759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 324/628] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:34.632633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229312-4223-4836-a7a1-32465f24e77a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.636245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72e7b-8534-4d9c-991d-a3738315d9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.637541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72e7b-8534-4d9c-991d-a3738315d9a5 None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.639799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72e7b-8534-4d9c-991d-a3738315d9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.640292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e72e7b-8534-4d9c-991d-a3738315d9a5 None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/590ac0c1da06460a8d32852f9c2e3609/roles/65669c196efb4b919bf9ee6dd9b1f623` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.662680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e72e7b-8534-4d9c-991d-a3738315d9a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=590ac0c1da06460a8d32852f9c2e3609, role_id=65669c196efb4b919bf9ee6dd9b1f623)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.664505 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e72e7b-8534-4d9c-991d-a3738315d9a5 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.767624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca229312-4223-4836-a7a1-32465f24e77a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:34.776333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 305/629] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:34 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/590ac0c1da06460a8d32852f9c2e3609/roles/65669c196efb4b919bf9ee6dd9b1f623 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:33:34.777444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72e7b-8534-4d9c-991d-a3738315d9a5 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.828090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7115a-2697-4c92-a2cb-46d8bf594218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:34.828719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7115a-2697-4c92-a2cb-46d8bf594218 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:34.828988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7115a-2697-4c92-a2cb-46d8bf594218 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:34.829260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7115a-2697-4c92-a2cb-46d8bf594218 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:34.830006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7115a-2697-4c92-a2cb-46d8bf594218 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:34.830312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7115a-2697-4c92-a2cb-46d8bf594218 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:34.831784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7115a-2697-4c92-a2cb-46d8bf594218 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:34.852224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.871531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:34.873024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 325/630] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:34.881541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7115a-2697-4c92-a2cb-46d8bf594218 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:34.955242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e72e7b-8534-4d9c-991d-a3738315d9a5 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.015305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac6cfd5-cadd-4dc4-bcdd-f5d3cddded37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.015977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6cfd5-cadd-4dc4-bcdd-f5d3cddded37 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.016259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6cfd5-cadd-4dc4-bcdd-f5d3cddded37 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.016539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac6cfd5-cadd-4dc4-bcdd-f5d3cddded37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.030187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac6cfd5-cadd-4dc4-bcdd-f5d3cddded37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-eac6cfd5-cadd-4dc4-bcdd-f5d3cddded37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:35.035168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:35.036151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:35.036989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:35.039676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 306/631] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:35.041433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca46027-7c4e-4579-91d4-f6db47968af6 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.041564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca46027-7c4e-4579-91d4-f6db47968af6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.041801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca46027-7c4e-4579-91d4-f6db47968af6 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.043343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 307/632] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:35.044179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca46027-7c4e-4579-91d4-f6db47968af6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.052985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7115a-2697-4c92-a2cb-46d8bf594218 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.095727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5574b-8d6e-44b5-acae-145fa1d9cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.096332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5574b-8d6e-44b5-acae-145fa1d9cd00 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.096611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5574b-8d6e-44b5-acae-145fa1d9cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.097409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5574b-8d6e-44b5-acae-145fa1d9cd00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.178453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.182151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca46027-7c4e-4579-91d4-f6db47968af6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.184351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.185333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5574b-8d6e-44b5-acae-145fa1d9cd00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.192106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5574b-8d6e-44b5-acae-145fa1d9cd00 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.231378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89483209-f831-4e11-889c-49fde4e1270c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.232030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483209-f831-4e11-889c-49fde4e1270c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.232307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483209-f831-4e11-889c-49fde4e1270c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.232583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89483209-f831-4e11-889c-49fde4e1270c None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.233268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89483209-f831-4e11-889c-49fde4e1270c None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:35.233575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89483209-f831-4e11-889c-49fde4e1270c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.235007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89483209-f831-4e11-889c-49fde4e1270c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.252797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 308/633] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:35.255075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447589b7-d92f-444f-a778-9a00722f3853 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.255732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447589b7-d92f-444f-a778-9a00722f3853 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.256112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447589b7-d92f-444f-a778-9a00722f3853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.280304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-447589b7-d92f-444f-a778-9a00722f3853 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:35.282473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-447589b7-d92f-444f-a778-9a00722f3853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:35.319350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 326/634] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:35.320332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5574b-8d6e-44b5-acae-145fa1d9cd00 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.369762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 309/635] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:35.370613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447589b7-d92f-444f-a778-9a00722f3853 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.428002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.435165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5574b-8d6e-44b5-acae-145fa1d9cd00 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.471292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103075f1-e90b-4dce-b1d5-3ed5a15ac2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.472294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103075f1-e90b-4dce-b1d5-3ed5a15ac2d5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.472855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103075f1-e90b-4dce-b1d5-3ed5a15ac2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.473331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103075f1-e90b-4dce-b1d5-3ed5a15ac2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.478973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.484007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103075f1-e90b-4dce-b1d5-3ed5a15ac2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.485663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103075f1-e90b-4dce-b1d5-3ed5a15ac2d5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.486005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447589b7-d92f-444f-a778-9a00722f3853 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-103075f1-e90b-4dce-b1d5-3ed5a15ac2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:35.500924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:35.501908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:35.502806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:35.502806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:35.502806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:35.505445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 327/636] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:35.506880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0cf78-c9f5-4da2-9ff9-a9146f308727 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.507376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0cf78-c9f5-4da2-9ff9-a9146f308727 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.507963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0cf78-c9f5-4da2-9ff9-a9146f308727 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.509802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 328/637] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:35.510723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0cf78-c9f5-4da2-9ff9-a9146f308727 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.532663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e99813-cbc3-4ba8-aaeb-eb204054c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.533357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e99813-cbc3-4ba8-aaeb-eb204054c869 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.533632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e99813-cbc3-4ba8-aaeb-eb204054c869 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.533945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e99813-cbc3-4ba8-aaeb-eb204054c869 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.545330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e99813-cbc3-4ba8-aaeb-eb204054c869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.546824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e99813-cbc3-4ba8-aaeb-eb204054c869 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-e5e99813-cbc3-4ba8-aaeb-eb204054c869 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:35.563957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:35.564955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:35.565856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:35.565856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:35.565856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:35.566025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 310/638] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:35.568097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47876c-f8bc-42c4-b8d7-03455cb691d5 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.568371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47876c-f8bc-42c4-b8d7-03455cb691d5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.568643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf47876c-f8bc-42c4-b8d7-03455cb691d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.599884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bf47876c-f8bc-42c4-b8d7-03455cb691d5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:35.601141 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bf47876c-f8bc-42c4-b8d7-03455cb691d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:35.624509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0cf78-c9f5-4da2-9ff9-a9146f308727 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.660370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459982d-7fa3-424b-9e0b-966b8eff2c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.660981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459982d-7fa3-424b-9e0b-966b8eff2c7a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.661289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459982d-7fa3-424b-9e0b-966b8eff2c7a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.661563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0459982d-7fa3-424b-9e0b-966b8eff2c7a None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.662212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459982d-7fa3-424b-9e0b-966b8eff2c7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:35.662512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459982d-7fa3-424b-9e0b-966b8eff2c7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.663915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0459982d-7fa3-424b-9e0b-966b8eff2c7a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.673897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 311/639] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:35.679666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47876c-f8bc-42c4-b8d7-03455cb691d5 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.679840 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 329/640] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:35.679840 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459982d-7fa3-424b-9e0b-966b8eff2c7a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.694931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.772811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.799812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf47876c-f8bc-42c4-b8d7-03455cb691d5 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.801682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0459982d-7fa3-424b-9e0b-966b8eff2c7a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.837824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b973e-e195-479f-9369-44c2ff1af65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.838495 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b973e-e195-479f-9369-44c2ff1af65c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.838776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b973e-e195-479f-9369-44c2ff1af65c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.839046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b973e-e195-479f-9369-44c2ff1af65c None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.839723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b973e-e195-479f-9369-44c2ff1af65c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:35.840281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b973e-e195-479f-9369-44c2ff1af65c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:35.842432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b973e-e195-479f-9369-44c2ff1af65c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:35.846292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2010d1-3872-46a0-8373-aa0fed2b373e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:35.846935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2010d1-3872-46a0-8373-aa0fed2b373e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:35.847210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2010d1-3872-46a0-8373-aa0fed2b373e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:35.847538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2010d1-3872-46a0-8373-aa0fed2b373e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:35.854191 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 312/641] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:35.855157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b973e-e195-479f-9369-44c2ff1af65c None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.864171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2010d1-3872-46a0-8373-aa0fed2b373e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-fd2010d1-3872-46a0-8373-aa0fed2b373e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:35.869102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:35.870015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:35.870871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 330/642] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:35.871618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2010d1-3872-46a0-8373-aa0fed2b373e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:35.938687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:35.974596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2010d1-3872-46a0-8373-aa0fed2b373e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:35.977660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b973e-e195-479f-9369-44c2ff1af65c None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.012628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d9ffa-08f7-4aaf-86a1-009a7d99f589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.013249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d9ffa-08f7-4aaf-86a1-009a7d99f589 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.013535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d9ffa-08f7-4aaf-86a1-009a7d99f589 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.013806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716d9ffa-08f7-4aaf-86a1-009a7d99f589 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.014094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99465a7-7c68-4dc0-91e1-2c43f13efa9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.014746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99465a7-7c68-4dc0-91e1-2c43f13efa9e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.015023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99465a7-7c68-4dc0-91e1-2c43f13efa9e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.015290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99465a7-7c68-4dc0-91e1-2c43f13efa9e None admin] PATH_INFO: `/v3/users/glance` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.018146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.021860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d9ffa-08f7-4aaf-86a1-009a7d99f589 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.023019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99465a7-7c68-4dc0-91e1-2c43f13efa9e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.023282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716d9ffa-08f7-4aaf-86a1-009a7d99f589 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.024538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99465a7-7c68-4dc0-91e1-2c43f13efa9e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-716d9ffa-08f7-4aaf-86a1-009a7d99f589 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:36.034427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:36.036162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:36.037082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:36.037082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:36.037082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:36.037082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:36.037082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:36.037082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:36.037082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:36.037082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-d99465a7-7c68-4dc0-91e1-2c43f13efa9e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:36.037519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:36.038350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 04 08:33:36.039353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:36.041554 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 331/643] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:36.041694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 313/644] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:35 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:36.041944 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d9ffa-08f7-4aaf-86a1-009a7d99f589 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.042177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99465a7-7c68-4dc0-91e1-2c43f13efa9e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.150710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99465a7-7c68-4dc0-91e1-2c43f13efa9e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.153157 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716d9ffa-08f7-4aaf-86a1-009a7d99f589 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.181335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.188229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f462f-5d69-4c24-800b-ca0147c424f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.188860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f462f-5d69-4c24-800b-ca0147c424f3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.189106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de11cf2-ba97-4f3e-9522-302b41a42871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.189219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f462f-5d69-4c24-800b-ca0147c424f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.189392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f462f-5d69-4c24-800b-ca0147c424f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.189776 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de11cf2-ba97-4f3e-9522-302b41a42871 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.190066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de11cf2-ba97-4f3e-9522-302b41a42871 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.190344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de11cf2-ba97-4f3e-9522-302b41a42871 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.191014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de11cf2-ba97-4f3e-9522-302b41a42871 None admin] RBAC: Adding query filter params (name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.191362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de11cf2-ba97-4f3e-9522-302b41a42871 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.192781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de11cf2-ba97-4f3e-9522-302b41a42871 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.200161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f462f-5d69-4c24-800b-ca0147c424f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:36.202246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 332/645] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.203098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de11cf2-ba97-4f3e-9522-302b41a42871 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-c81f462f-5d69-4c24-800b-ca0147c424f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:36.205893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:36.207041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 314/646] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:36.208093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f462f-5d69-4c24-800b-ca0147c424f3 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.276335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.311347 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de11cf2-ba97-4f3e-9522-302b41a42871 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.324652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f462f-5d69-4c24-800b-ca0147c424f3 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.345406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80473e37-6a83-42fa-ac66-794d2a25567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.346183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80473e37-6a83-42fa-ac66-794d2a25567a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.346608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80473e37-6a83-42fa-ac66-794d2a25567a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.347049 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80473e37-6a83-42fa-ac66-794d2a25567a None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.348420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80473e37-6a83-42fa-ac66-794d2a25567a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.348882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80473e37-6a83-42fa-ac66-794d2a25567a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.350419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80473e37-6a83-42fa-ac66-794d2a25567a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.359363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf49d57-1880-44d6-a8e6-c14e0922d717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.359992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf49d57-1880-44d6-a8e6-c14e0922d717 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.360281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf49d57-1880-44d6-a8e6-c14e0922d717 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.360554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf49d57-1880-44d6-a8e6-c14e0922d717 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.361281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf49d57-1880-44d6-a8e6-c14e0922d717 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.361588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf49d57-1880-44d6-a8e6-c14e0922d717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.362541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 333/647] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.363003 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf49d57-1880-44d6-a8e6-c14e0922d717 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.364247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80473e37-6a83-42fa-ac66-794d2a25567a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.384604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 315/648] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.385656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf49d57-1880-44d6-a8e6-c14e0922d717 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.420058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.474170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80473e37-6a83-42fa-ac66-794d2a25567a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.494604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf49d57-1880-44d6-a8e6-c14e0922d717 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.508933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.509498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a33059-bd11-42aa-b189-7f9ed4016a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.510264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a33059-bd11-42aa-b189-7f9ed4016a68 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.510687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a33059-bd11-42aa-b189-7f9ed4016a68 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.510965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a33059-bd11-42aa-b189-7f9ed4016a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.522368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a33059-bd11-42aa-b189-7f9ed4016a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.523820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a33059-bd11-42aa-b189-7f9ed4016a68 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.529242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae65141-20bc-4b69-9dec-9d7328fca2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.529789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae65141-20bc-4b69-9dec-9d7328fca2b4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.530067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae65141-20bc-4b69-9dec-9d7328fca2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.530334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae65141-20bc-4b69-9dec-9d7328fca2b4 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.530988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae65141-20bc-4b69-9dec-9d7328fca2b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.531286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae65141-20bc-4b69-9dec-9d7328fca2b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.532645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae65141-20bc-4b69-9dec-9d7328fca2b4 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-48a33059-bd11-42aa-b189-7f9ed4016a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:36.538904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:36.540192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:36.541286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:36.541286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:36.541286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:36.541286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 334/649] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:36.541286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a33059-bd11-42aa-b189-7f9ed4016a68 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.547133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 316/650] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.548280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae65141-20bc-4b69-9dec-9d7328fca2b4 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.660822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae65141-20bc-4b69-9dec-9d7328fca2b4 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.662620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a33059-bd11-42aa-b189-7f9ed4016a68 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.664790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.696954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b6f6f-5ad9-448c-a6b3-36faa4e72bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.697562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b6f6f-5ad9-448c-a6b3-36faa4e72bd6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.697843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b6f6f-5ad9-448c-a6b3-36faa4e72bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.698117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b6f6f-5ad9-448c-a6b3-36faa4e72bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.700230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9dabd-c96a-459e-95be-aeeac059f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.700836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9dabd-c96a-459e-95be-aeeac059f8d1 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.701118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9dabd-c96a-459e-95be-aeeac059f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.701394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f9dabd-c96a-459e-95be-aeeac059f8d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.702127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9dabd-c96a-459e-95be-aeeac059f8d1 None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=e05901861bc34c2398ec600150296657) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.702438 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9dabd-c96a-459e-95be-aeeac059f8d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.703968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f9dabd-c96a-459e-95be-aeeac059f8d1 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.710599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 335/651] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/role_assignments?user.id=e05901861bc34c2398ec600150296657&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.711471 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9dabd-c96a-459e-95be-aeeac059f8d1 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.768931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.802591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b6f6f-5ad9-448c-a6b3-36faa4e72bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.805144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b6f6f-5ad9-448c-a6b3-36faa4e72bd6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.829917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f9dabd-c96a-459e-95be-aeeac059f8d1 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:36.870729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cbf0d-9c20-4323-a9ff-c171e783d003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:36.871359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cbf0d-9c20-4323-a9ff-c171e783d003 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:36.871666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cbf0d-9c20-4323-a9ff-c171e783d003 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:36.871939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3cbf0d-9c20-4323-a9ff-c171e783d003 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:36.873001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cbf0d-9c20-4323-a9ff-c171e783d003 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:36.873001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cbf0d-9c20-4323-a9ff-c171e783d003 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:36.874382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3cbf0d-9c20-4323-a9ff-c171e783d003 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:36.888102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 336/652] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:36.889011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cbf0d-9c20-4323-a9ff-c171e783d003 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:36.924660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:36.943804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 317/653] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:36.944887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b6f6f-5ad9-448c-a6b3-36faa4e72bd6 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.027812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3cbf0d-9c20-4323-a9ff-c171e783d003 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.041597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:37.066723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ae636-e28d-4044-93ee-5b17c89fc56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.067284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ae636-e28d-4044-93ee-5b17c89fc56b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.067656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ae636-e28d-4044-93ee-5b17c89fc56b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.068027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0ae636-e28d-4044-93ee-5b17c89fc56b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.069091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b6f6f-5ad9-448c-a6b3-36faa4e72bd6 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.078668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ae636-e28d-4044-93ee-5b17c89fc56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.080014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0ae636-e28d-4044-93ee-5b17c89fc56b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-1f0ae636-e28d-4044-93ee-5b17c89fc56b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:37.095256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:37.096493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:37.097694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:37.097694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:37.097694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:37.099061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 337/654] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:37.100012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ae636-e28d-4044-93ee-5b17c89fc56b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.110560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e43a6b-66e4-4b56-8b86-994747c88bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.111194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e43a6b-66e4-4b56-8b86-994747c88bb3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.111473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e43a6b-66e4-4b56-8b86-994747c88bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.111775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e43a6b-66e4-4b56-8b86-994747c88bb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.119390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e43a6b-66e4-4b56-8b86-994747c88bb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.121040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e43a6b-66e4-4b56-8b86-994747c88bb3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-84e43a6b-66e4-4b56-8b86-994747c88bb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:37.135860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:37.137034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:33:37.138219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:37.140807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 318/655] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:37.142508 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e382-cc8f-48d1-9d15-c094ea73f9d5 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.143217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e382-cc8f-48d1-9d15-c094ea73f9d5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.143940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80e382-cc8f-48d1-9d15-c094ea73f9d5 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.146138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 319/656] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:37.147010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e382-cc8f-48d1-9d15-c094ea73f9d5 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.179945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:37.202719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0ae636-e28d-4044-93ee-5b17c89fc56b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.237668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3dc68-6f74-4ce8-b15e-e7c552ccdb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.238318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3dc68-6f74-4ce8-b15e-e7c552ccdb07 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.238597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3dc68-6f74-4ce8-b15e-e7c552ccdb07 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.238873 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3dc68-6f74-4ce8-b15e-e7c552ccdb07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.249256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3dc68-6f74-4ce8-b15e-e7c552ccdb07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.250690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3dc68-6f74-4ce8-b15e-e7c552ccdb07 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.258321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80e382-cc8f-48d1-9d15-c094ea73f9d5 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-b1d3dc68-6f74-4ce8-b15e-e7c552ccdb07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:37.265470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:37.266602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:37.267492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:37.267492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:37.267492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:37.267492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 338/657] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:37.267492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3dc68-6f74-4ce8-b15e-e7c552ccdb07 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.299071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5800bd-f9a7-4e3d-bd30-101622fc9182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.299686 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5800bd-f9a7-4e3d-bd30-101622fc9182 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.299968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5800bd-f9a7-4e3d-bd30-101622fc9182 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.300239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5800bd-f9a7-4e3d-bd30-101622fc9182 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.301654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5800bd-f9a7-4e3d-bd30-101622fc9182 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:37.301956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5800bd-f9a7-4e3d-bd30-101622fc9182 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.303298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5800bd-f9a7-4e3d-bd30-101622fc9182 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.306853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:37.322379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 320/658] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:37.322379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded161-3b93-4b48-af85-3b0bce649181 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.322379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded161-3b93-4b48-af85-3b0bce649181 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.322379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ded161-3b93-4b48-af85-3b0bce649181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.339683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-82ded161-3b93-4b48-af85-3b0bce649181 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:37.341017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-82ded161-3b93-4b48-af85-3b0bce649181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:37.376266 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3dc68-6f74-4ce8-b15e-e7c552ccdb07 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.403885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:37.419533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 321/659] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:37.419744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143361-3f7a-4a32-9e98-defe0600ea61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.419864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ded161-3b93-4b48-af85-3b0bce649181 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.419951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143361-3f7a-4a32-9e98-defe0600ea61 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.419951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143361-3f7a-4a32-9e98-defe0600ea61 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.419951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea143361-3f7a-4a32-9e98-defe0600ea61 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.419951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143361-3f7a-4a32-9e98-defe0600ea61 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:37.419951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143361-3f7a-4a32-9e98-defe0600ea61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.419951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea143361-3f7a-4a32-9e98-defe0600ea61 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.432083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 339/660] 10.222.0.25 () {56 vars in 1137 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:37.432907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143361-3f7a-4a32-9e98-defe0600ea61 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.537684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea143361-3f7a-4a32-9e98-defe0600ea61 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.555127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ded161-3b93-4b48-af85-3b0bce649181 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.580097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0a4c-745e-46d7-9b27-515790099ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.580804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0a4c-745e-46d7-9b27-515790099ccf None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.581087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0a4c-745e-46d7-9b27-515790099ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.581409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc0a4c-745e-46d7-9b27-515790099ccf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.586839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:37.595655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc0a4c-745e-46d7-9b27-515790099ccf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.595805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c860b8-dcde-4290-bf7e-c978def9e2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.596302 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c860b8-dcde-4290-bf7e-c978def9e2b4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.596580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c860b8-dcde-4290-bf7e-c978def9e2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.596851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c860b8-dcde-4290-bf7e-c978def9e2b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.597547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c860b8-dcde-4290-bf7e-c978def9e2b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:37.597850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c860b8-dcde-4290-bf7e-c978def9e2b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.598546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc0a4c-745e-46d7-9b27-515790099ccf None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.599249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c860b8-dcde-4290-bf7e-c978def9e2b4 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-c3cc0a4c-745e-46d7-9b27-515790099ccf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:37.611786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:37.612775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 04 08:33:37.614377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:37.621131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 322/662] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:37.621131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c860b8-dcde-4290-bf7e-c978def9e2b4 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.621477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 340/662] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:37.622573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0a4c-745e-46d7-9b27-515790099ccf None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.689915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:37.737532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c860b8-dcde-4290-bf7e-c978def9e2b4 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.746131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc0a4c-745e-46d7-9b27-515790099ccf None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.773419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a7dc-1103-4218-bf95-7fbaae71f0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.774333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a7dc-1103-4218-bf95-7fbaae71f0c4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.774810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a7dc-1103-4218-bf95-7fbaae71f0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.775272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65a7dc-1103-4218-bf95-7fbaae71f0c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.784761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc3192-3493-49e1-ae38-e95d68e4814c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.785421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc3192-3493-49e1-ae38-e95d68e4814c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.785700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc3192-3493-49e1-ae38-e95d68e4814c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.785969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afc3192-3493-49e1-ae38-e95d68e4814c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.792434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc3192-3493-49e1-ae38-e95d68e4814c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.793855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afc3192-3493-49e1-ae38-e95d68e4814c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-2afc3192-3493-49e1-ae38-e95d68e4814c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:37.805078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:37.806059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 341/663] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:37.806967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc3192-3493-49e1-ae38-e95d68e4814c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.838778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:37.854157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a7dc-1103-4218-bf95-7fbaae71f0c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.855620 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65a7dc-1103-4218-bf95-7fbaae71f0c4 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.916865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afc3192-3493-49e1-ae38-e95d68e4814c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:37.927222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:37.950675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417504-6243-4408-b156-e353b287b524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:37.951275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417504-6243-4408-b156-e353b287b524 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:37.951608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417504-6243-4408-b156-e353b287b524 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:37.951854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72417504-6243-4408-b156-e353b287b524 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:37.952593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417504-6243-4408-b156-e353b287b524 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:37.952877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417504-6243-4408-b156-e353b287b524 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:37.954278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72417504-6243-4408-b156-e353b287b524 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:37.966407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 323/664] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:37.966407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a7dc-1103-4218-bf95-7fbaae71f0c4 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:37.978241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 342/665] 10.222.0.25 () {56 vars in 1139 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:37.978939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417504-6243-4408-b156-e353b287b524 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.057148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.073977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65a7dc-1103-4218-bf95-7fbaae71f0c4 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.084715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72417504-6243-4408-b156-e353b287b524 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.111235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b3b7f-7b71-47a9-8e1a-3db93ff47474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.111837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b3b7f-7b71-47a9-8e1a-3db93ff47474 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.112112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b3b7f-7b71-47a9-8e1a-3db93ff47474 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.112461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97b3b7f-7b71-47a9-8e1a-3db93ff47474 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.120377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae5bbc-4374-4987-a29e-37a641536f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.121167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae5bbc-4374-4987-a29e-37a641536f4a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.121609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae5bbc-4374-4987-a29e-37a641536f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.121885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dae5bbc-4374-4987-a29e-37a641536f4a None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.122575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae5bbc-4374-4987-a29e-37a641536f4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:38.122879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae5bbc-4374-4987-a29e-37a641536f4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.123992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97b3b7f-7b71-47a9-8e1a-3db93ff47474 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:38.124312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dae5bbc-4374-4987-a29e-37a641536f4a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-f97b3b7f-7b71-47a9-8e1a-3db93ff47474 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:38.129379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:38.130296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:38.131155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 324/666] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:38.131901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b3b7f-7b71-47a9-8e1a-3db93ff47474 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.146181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 343/667] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:38.146181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae5bbc-4374-4987-a29e-37a641536f4a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.173617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.241799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97b3b7f-7b71-47a9-8e1a-3db93ff47474 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.249251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dae5bbc-4374-4987-a29e-37a641536f4a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.276921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bc07d-47e9-4bdb-b990-79cd88c1bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.277592 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bc07d-47e9-4bdb-b990-79cd88c1bc68 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.277838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bc07d-47e9-4bdb-b990-79cd88c1bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.278105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0bc07d-47e9-4bdb-b990-79cd88c1bc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.283939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2bf5d-7704-4858-b3b4-a446cff90447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.284794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2bf5d-7704-4858-b3b4-a446cff90447 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.284914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2bf5d-7704-4858-b3b4-a446cff90447 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.285092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b2bf5d-7704-4858-b3b4-a446cff90447 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.288641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bc07d-47e9-4bdb-b990-79cd88c1bc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.290082 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0bc07d-47e9-4bdb-b990-79cd88c1bc68 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.297889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-1e0bc07d-47e9-4bdb-b990-79cd88c1bc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:38.307295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:38.312515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:38.313530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:38.313530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:38.313530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:38.313530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 325/668] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:38.313530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bc07d-47e9-4bdb-b990-79cd88c1bc68 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.362633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2bf5d-7704-4858-b3b4-a446cff90447 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.364553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b2bf5d-7704-4858-b3b4-a446cff90447 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.392142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.416001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0bc07d-47e9-4bdb-b990-79cd88c1bc68 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.455812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea645fa7-9524-4f06-aaf4-9e605f8f4612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.456415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea645fa7-9524-4f06-aaf4-9e605f8f4612 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.456730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea645fa7-9524-4f06-aaf4-9e605f8f4612 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.456986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea645fa7-9524-4f06-aaf4-9e605f8f4612 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.457648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea645fa7-9524-4f06-aaf4-9e605f8f4612 None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:38.457946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea645fa7-9524-4f06-aaf4-9e605f8f4612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.459303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea645fa7-9524-4f06-aaf4-9e605f8f4612 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.471748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 326/669] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:38.471748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea645fa7-9524-4f06-aaf4-9e605f8f4612 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.472804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 344/670] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:38.473827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2bf5d-7704-4858-b3b4-a446cff90447 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.533626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.577942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b2bf5d-7704-4858-b3b4-a446cff90447 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.582319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea645fa7-9524-4f06-aaf4-9e605f8f4612 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.608916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.617730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10361e1d-ecc6-4859-a10a-320f939cab8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.618332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10361e1d-ecc6-4859-a10a-320f939cab8b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.618632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10361e1d-ecc6-4859-a10a-320f939cab8b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.618881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10361e1d-ecc6-4859-a10a-320f939cab8b None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.619537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10361e1d-ecc6-4859-a10a-320f939cab8b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:38.625496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10361e1d-ecc6-4859-a10a-320f939cab8b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.625594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e159f69-50ef-476f-b63a-277cb441c63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.625703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10361e1d-ecc6-4859-a10a-320f939cab8b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.625783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e159f69-50ef-476f-b63a-277cb441c63d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.625783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e159f69-50ef-476f-b63a-277cb441c63d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.625783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e159f69-50ef-476f-b63a-277cb441c63d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.625783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e159f69-50ef-476f-b63a-277cb441c63d None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=4289134c7df04f96a5c4661165105109) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:38.625783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e159f69-50ef-476f-b63a-277cb441c63d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.625783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e159f69-50ef-476f-b63a-277cb441c63d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.630774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 327/671] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/role_assignments?user.id=4289134c7df04f96a5c4661165105109&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:38.637683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 345/672] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:38.637683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10361e1d-ecc6-4859-a10a-320f939cab8b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.637969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e159f69-50ef-476f-b63a-277cb441c63d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.767114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10361e1d-ecc6-4859-a10a-320f939cab8b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.773380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e159f69-50ef-476f-b63a-277cb441c63d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.804519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.807279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261092b-2c6c-4025-a3c8-b39dcdc6f1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.808024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261092b-2c6c-4025-a3c8-b39dcdc6f1a2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.808377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261092b-2c6c-4025-a3c8-b39dcdc6f1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.808778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261092b-2c6c-4025-a3c8-b39dcdc6f1a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.822489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261092b-2c6c-4025-a3c8-b39dcdc6f1a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.824205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261092b-2c6c-4025-a3c8-b39dcdc6f1a2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.825604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a46ff4-7fce-4a0c-a30d-95572d7bf992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:38.826244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a46ff4-7fce-4a0c-a30d-95572d7bf992 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:38.826521 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a46ff4-7fce-4a0c-a30d-95572d7bf992 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:38.826788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a46ff4-7fce-4a0c-a30d-95572d7bf992 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:38.838565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a46ff4-7fce-4a0c-a30d-95572d7bf992 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:38.840043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a46ff4-7fce-4a0c-a30d-95572d7bf992 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-7261092b-2c6c-4025-a3c8-b39dcdc6f1a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:38.840648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:38.841692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:38.842580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:38.842580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:38.842580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:38.844943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 346/673] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:38.845944 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261092b-2c6c-4025-a3c8-b39dcdc6f1a2 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-a8a46ff4-7fce-4a0c-a30d-95572d7bf992 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:38.857966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:38.858933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:38.860360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:38.860360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:38.860360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:38.860360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 328/674] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:38.860360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a46ff4-7fce-4a0c-a30d-95572d7bf992 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:38.890626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:38.971293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261092b-2c6c-4025-a3c8-b39dcdc6f1a2 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:38.983301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a46ff4-7fce-4a0c-a30d-95572d7bf992 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.019706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5e85d-ee62-41cf-9ce2-4f5926081489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.020315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5e85d-ee62-41cf-9ce2-4f5926081489 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.020593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5e85d-ee62-41cf-9ce2-4f5926081489 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.020865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5e85d-ee62-41cf-9ce2-4f5926081489 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.021505 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5e85d-ee62-41cf-9ce2-4f5926081489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:39.021808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5e85d-ee62-41cf-9ce2-4f5926081489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.023159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5e85d-ee62-41cf-9ce2-4f5926081489 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.024809 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3172f-e7f1-4279-9a87-717855dae308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.026254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3172f-e7f1-4279-9a87-717855dae308 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.026751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3172f-e7f1-4279-9a87-717855dae308 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.027232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3172f-e7f1-4279-9a87-717855dae308 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.036471 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3172f-e7f1-4279-9a87-717855dae308 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.036768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 329/675] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:39.037412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5e85d-ee62-41cf-9ce2-4f5926081489 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.038749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3172f-e7f1-4279-9a87-717855dae308 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-9de3172f-e7f1-4279-9a87-717855dae308 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:39.052666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:39.053602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:39.054530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:39.054530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:39.054530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:39.054530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:39.054530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:39.054530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:39.054530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:39.054530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:39.054530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 347/676] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:39.055481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8564b93-58dc-4cd0-9149-b8c6aeeb309a None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.055628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8564b93-58dc-4cd0-9149-b8c6aeeb309a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.055886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8564b93-58dc-4cd0-9149-b8c6aeeb309a None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.057256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 348/677] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:39.059634 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8564b93-58dc-4cd0-9149-b8c6aeeb309a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.078060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.149623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5e85d-ee62-41cf-9ce2-4f5926081489 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.161416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.166093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8564b93-58dc-4cd0-9149-b8c6aeeb309a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.186401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8175-43b6-472c-8dc4-39ef552e7ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.187432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8175-43b6-472c-8dc4-39ef552e7ac1 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.187747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8175-43b6-472c-8dc4-39ef552e7ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.188165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f8175-43b6-472c-8dc4-39ef552e7ac1 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.188883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8175-43b6-472c-8dc4-39ef552e7ac1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:39.189188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8175-43b6-472c-8dc4-39ef552e7ac1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.190543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f8175-43b6-472c-8dc4-39ef552e7ac1 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.202749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bd93d0-d4f9-45ae-bb3c-ecad62195938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.208449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd93d0-d4f9-45ae-bb3c-ecad62195938 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.208579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 330/678] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:39.208676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd93d0-d4f9-45ae-bb3c-ecad62195938 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.208676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bd93d0-d4f9-45ae-bb3c-ecad62195938 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.208851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8175-43b6-472c-8dc4-39ef552e7ac1 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.216089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd93d0-d4f9-45ae-bb3c-ecad62195938 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.217780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bd93d0-d4f9-45ae-bb3c-ecad62195938 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-00bd93d0-d4f9-45ae-bb3c-ecad62195938 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:39.229923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:39.230995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:39.232281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:39.232281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:39.232281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:39.232281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:39.232281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:39.232281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:39.232281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:39.232281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:39.232281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 349/679] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:39.234581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe239-1725-4744-a6d4-d75ebcac96cc None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.235012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe239-1725-4744-a6d4-d75ebcac96cc None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.235530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6fe239-1725-4744-a6d4-d75ebcac96cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.254141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-cb6fe239-1725-4744-a6d4-d75ebcac96cc None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:39.255332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cb6fe239-1725-4744-a6d4-d75ebcac96cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:39.310137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.317005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f8175-43b6-472c-8dc4-39ef552e7ac1 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.324327 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 350/680] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:39.325243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fe239-1725-4744-a6d4-d75ebcac96cc None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.368571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b6a2-5a30-4fa3-8167-abd3b0f4530a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.369322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b6a2-5a30-4fa3-8167-abd3b0f4530a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.369604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b6a2-5a30-4fa3-8167-abd3b0f4530a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.369877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8891b6a2-5a30-4fa3-8167-abd3b0f4530a None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.371081 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891b6a2-5a30-4fa3-8167-abd3b0f4530a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:39.371386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891b6a2-5a30-4fa3-8167-abd3b0f4530a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.373317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8891b6a2-5a30-4fa3-8167-abd3b0f4530a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.389785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 331/681] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:39.390658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b6a2-5a30-4fa3-8167-abd3b0f4530a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.436481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.454062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6fe239-1725-4744-a6d4-d75ebcac96cc None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.500569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305795-7d02-4bd7-9a33-f1e6fb026178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.501601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305795-7d02-4bd7-9a33-f1e6fb026178 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.501887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305795-7d02-4bd7-9a33-f1e6fb026178 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.502159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af305795-7d02-4bd7-9a33-f1e6fb026178 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.511747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8891b6a2-5a30-4fa3-8167-abd3b0f4530a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.512024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305795-7d02-4bd7-9a33-f1e6fb026178 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.513483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af305795-7d02-4bd7-9a33-f1e6fb026178 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-af305795-7d02-4bd7-9a33-f1e6fb026178 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:39.529525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:39.530803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:39.532138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:39.535592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 351/682] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:39.536830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305795-7d02-4bd7-9a33-f1e6fb026178 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.556636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24f204-6197-4bab-b960-190acf7cb708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.557793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24f204-6197-4bab-b960-190acf7cb708 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.558219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24f204-6197-4bab-b960-190acf7cb708 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.558773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24f204-6197-4bab-b960-190acf7cb708 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.559752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24f204-6197-4bab-b960-190acf7cb708 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:39.560221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24f204-6197-4bab-b960-190acf7cb708 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.561824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24f204-6197-4bab-b960-190acf7cb708 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.577875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 332/683] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:39.579079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24f204-6197-4bab-b960-190acf7cb708 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.602454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.644026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af305795-7d02-4bd7-9a33-f1e6fb026178 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.680385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03abe1-bfab-42e5-af7d-5d740ee6d47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.681111 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03abe1-bfab-42e5-af7d-5d740ee6d47a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.681457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03abe1-bfab-42e5-af7d-5d740ee6d47a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.681801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03abe1-bfab-42e5-af7d-5d740ee6d47a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.682609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03abe1-bfab-42e5-af7d-5d740ee6d47a None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=6f4df3626bdb4e3a88ce27eaabf4ca1f) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:39.682988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03abe1-bfab-42e5-af7d-5d740ee6d47a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.684538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03abe1-bfab-42e5-af7d-5d740ee6d47a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.691858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 352/684] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/role_assignments?user.id=6f4df3626bdb4e3a88ce27eaabf4ca1f&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:39.692864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03abe1-bfab-42e5-af7d-5d740ee6d47a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.705380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24f204-6197-4bab-b960-190acf7cb708 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.714600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.756166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb857-d286-408b-9686-5d66794657ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.756906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb857-d286-408b-9686-5d66794657ad None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.757263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb857-d286-408b-9686-5d66794657ad None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.757609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefb857-d286-408b-9686-5d66794657ad None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.758448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefb857-d286-408b-9686-5d66794657ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:39.758448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefb857-d286-408b-9686-5d66794657ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.761132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aefb857-d286-408b-9686-5d66794657ad None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.792406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 333/685] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:39.792406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb857-d286-408b-9686-5d66794657ad None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.845590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03abe1-bfab-42e5-af7d-5d740ee6d47a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.896418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:39.901424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b258030-afdd-4883-ad58-ef90dd87703e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.902032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b258030-afdd-4883-ad58-ef90dd87703e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.902310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b258030-afdd-4883-ad58-ef90dd87703e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.902574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b258030-afdd-4883-ad58-ef90dd87703e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.903295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b258030-afdd-4883-ad58-ef90dd87703e None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=a269743c34bc48edaab5c0e3e78074c5) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:39.903629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b258030-afdd-4883-ad58-ef90dd87703e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:39.905121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b258030-afdd-4883-ad58-ef90dd87703e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:39.912065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 353/686] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/role_assignments?user.id=a269743c34bc48edaab5c0e3e78074c5&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:39.912871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b258030-afdd-4883-ad58-ef90dd87703e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:39.926577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefb857-d286-408b-9686-5d66794657ad None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:39.973852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077161b7-7b1c-4ffb-a7a3-6fd4c80e7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:39.974597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077161b7-7b1c-4ffb-a7a3-6fd4c80e7171 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:39.974974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077161b7-7b1c-4ffb-a7a3-6fd4c80e7171 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:39.975347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077161b7-7b1c-4ffb-a7a3-6fd4c80e7171 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:39.989827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077161b7-7b1c-4ffb-a7a3-6fd4c80e7171 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-077161b7-7b1c-4ffb-a7a3-6fd4c80e7171 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:39.995791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:39.996933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:39.997943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:40.001399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 334/687] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:40.007481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077161b7-7b1c-4ffb-a7a3-6fd4c80e7171 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.010578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.044380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b258030-afdd-4883-ad58-ef90dd87703e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.106158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5a4a5-5714-4b75-8ba9-c53f5016feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.106780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5a4a5-5714-4b75-8ba9-c53f5016feb7 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.107058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5a4a5-5714-4b75-8ba9-c53f5016feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.107331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5a4a5-5714-4b75-8ba9-c53f5016feb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.167162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077161b7-7b1c-4ffb-a7a3-6fd4c80e7171 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.205207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b717e53-ace9-48fb-a0d5-0fc432ff1851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.205975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b717e53-ace9-48fb-a0d5-0fc432ff1851 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.206374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b717e53-ace9-48fb-a0d5-0fc432ff1851 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.206761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b717e53-ace9-48fb-a0d5-0fc432ff1851 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.208116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b717e53-ace9-48fb-a0d5-0fc432ff1851 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:40.208860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b717e53-ace9-48fb-a0d5-0fc432ff1851 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.210468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b717e53-ace9-48fb-a0d5-0fc432ff1851 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.211987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.218424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5a4a5-5714-4b75-8ba9-c53f5016feb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.220444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5a4a5-5714-4b75-8ba9-c53f5016feb7 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.221546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 335/688] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:40.228184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b717e53-ace9-48fb-a0d5-0fc432ff1851 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.312363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.347822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 354/689] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:40.351742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5a4a5-5714-4b75-8ba9-c53f5016feb7 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.359952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b717e53-ace9-48fb-a0d5-0fc432ff1851 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.401227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3225f0-b665-45a3-8c48-2ea5d2c861ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.401862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3225f0-b665-45a3-8c48-2ea5d2c861ba None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.402145 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3225f0-b665-45a3-8c48-2ea5d2c861ba None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.402417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3225f0-b665-45a3-8c48-2ea5d2c861ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.413858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3225f0-b665-45a3-8c48-2ea5d2c861ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.424412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3225f0-b665-45a3-8c48-2ea5d2c861ba None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-ab3225f0-b665-45a3-8c48-2ea5d2c861ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:40.443691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:40.444690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:40.446179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:40.446179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:40.446179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:40.446179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 336/690] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:40.456468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3225f0-b665-45a3-8c48-2ea5d2c861ba None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.471905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5a4a5-5714-4b75-8ba9-c53f5016feb7 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.531721 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ad7e-94fc-42d9-9e22-1c1e8ac566be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.535415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ad7e-94fc-42d9-9e22-1c1e8ac566be None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.535737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ad7e-94fc-42d9-9e22-1c1e8ac566be None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.536018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85ad7e-94fc-42d9-9e22-1c1e8ac566be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.554038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85ad7e-94fc-42d9-9e22-1c1e8ac566be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.555677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85ad7e-94fc-42d9-9e22-1c1e8ac566be None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.559538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-ba85ad7e-94fc-42d9-9e22-1c1e8ac566be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:40.597876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:40.598818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:40.600199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:40.600199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:40.600199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:40.603692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 355/691] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:40.605234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ad7e-94fc-42d9-9e22-1c1e8ac566be None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.651683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:40.663313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3225f0-b665-45a3-8c48-2ea5d2c861ba None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.734329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adb836-9f3c-4f80-9be1-b786be4ff7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.735087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adb836-9f3c-4f80-9be1-b786be4ff7a9 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.735439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adb836-9f3c-4f80-9be1-b786be4ff7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.735802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83adb836-9f3c-4f80-9be1-b786be4ff7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.736574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adb836-9f3c-4f80-9be1-b786be4ff7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:40.736949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adb836-9f3c-4f80-9be1-b786be4ff7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.738794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83adb836-9f3c-4f80-9be1-b786be4ff7a9 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.763447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 337/692] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:40.768667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85ad7e-94fc-42d9-9e22-1c1e8ac566be None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.770264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adb836-9f3c-4f80-9be1-b786be4ff7a9 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.836923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2cd6a-53a7-428d-b0e4-4022e54fb825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:40.837738 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2cd6a-53a7-428d-b0e4-4022e54fb825 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:40.838083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2cd6a-53a7-428d-b0e4-4022e54fb825 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:40.843270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa2cd6a-53a7-428d-b0e4-4022e54fb825 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:40.844152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2cd6a-53a7-428d-b0e4-4022e54fb825 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:40.844533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2cd6a-53a7-428d-b0e4-4022e54fb825 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:40.846036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa2cd6a-53a7-428d-b0e4-4022e54fb825 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:40.862441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 356/693] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:40.868589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2cd6a-53a7-428d-b0e4-4022e54fb825 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:40.973522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83adb836-9f3c-4f80-9be1-b786be4ff7a9 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:40.987615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.035165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6984b3-765a-4288-8479-68802b89ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.036166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6984b3-765a-4288-8479-68802b89ed13 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.036463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6984b3-765a-4288-8479-68802b89ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.036740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6984b3-765a-4288-8479-68802b89ed13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.041011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.046651 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6984b3-765a-4288-8479-68802b89ed13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.048136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6984b3-765a-4288-8479-68802b89ed13 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.056208 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa2cd6a-53a7-428d-b0e4-4022e54fb825 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-2c6984b3-765a-4288-8479-68802b89ed13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:41.060846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:41.061756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:41.062699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 338/694] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:41.063397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287b641-bef3-4ab3-9c67-971350aa8cb4 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.067823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287b641-bef3-4ab3-9c67-971350aa8cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.068121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287b641-bef3-4ab3-9c67-971350aa8cb4 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.069665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 339/695] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:41.071690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287b641-bef3-4ab3-9c67-971350aa8cb4 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.097883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d14ff2-97c6-40a7-9da5-9bb35cd7b05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.098847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d14ff2-97c6-40a7-9da5-9bb35cd7b05b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.099619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d14ff2-97c6-40a7-9da5-9bb35cd7b05b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.100138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d14ff2-97c6-40a7-9da5-9bb35cd7b05b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.109055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d14ff2-97c6-40a7-9da5-9bb35cd7b05b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.111827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d14ff2-97c6-40a7-9da5-9bb35cd7b05b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-92d14ff2-97c6-40a7-9da5-9bb35cd7b05b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:41.127575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:41.129247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:41.130235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:41.130235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:41.130235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:41.130235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:41.130235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:41.130235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:41.130235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:41.130235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:41.130235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 357/696] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:41.131539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e6853-a47f-45b2-a754-7524599d6f86 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.131539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e6853-a47f-45b2-a754-7524599d6f86 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.131539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e6853-a47f-45b2-a754-7524599d6f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.155103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f87e6853-a47f-45b2-a754-7524599d6f86 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:41.156385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f87e6853-a47f-45b2-a754-7524599d6f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:41.194263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287b641-bef3-4ab3-9c67-971350aa8cb4 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.231392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa95b3-fd76-4b9f-844f-07d84ca238f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.232042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa95b3-fd76-4b9f-844f-07d84ca238f3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.232490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa95b3-fd76-4b9f-844f-07d84ca238f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.232773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baa95b3-fd76-4b9f-844f-07d84ca238f3 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.233828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa95b3-fd76-4b9f-844f-07d84ca238f3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:41.234289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa95b3-fd76-4b9f-844f-07d84ca238f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.235958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baa95b3-fd76-4b9f-844f-07d84ca238f3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.239647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 358/697] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:41.240485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e6853-a47f-45b2-a754-7524599d6f86 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.261331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 340/698] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:41.268093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa95b3-fd76-4b9f-844f-07d84ca238f3 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.349016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.351203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.371818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e6853-a47f-45b2-a754-7524599d6f86 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.407556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16645ec6-00f0-44b7-9155-910d4eab91b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.408615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16645ec6-00f0-44b7-9155-910d4eab91b3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.409091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16645ec6-00f0-44b7-9155-910d4eab91b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.410113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16645ec6-00f0-44b7-9155-910d4eab91b3 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.411021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16645ec6-00f0-44b7-9155-910d4eab91b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:41.411544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16645ec6-00f0-44b7-9155-910d4eab91b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.413850 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16645ec6-00f0-44b7-9155-910d4eab91b3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.428594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 359/699] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:41.434989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16645ec6-00f0-44b7-9155-910d4eab91b3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.526991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baa95b3-fd76-4b9f-844f-07d84ca238f3 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.554298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16645ec6-00f0-44b7-9155-910d4eab91b3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.564051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4e3d0-e70c-4285-bc27-0c10a9e86e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.564662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4e3d0-e70c-4285-bc27-0c10a9e86e49 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.564941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4e3d0-e70c-4285-bc27-0c10a9e86e49 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.565216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a4e3d0-e70c-4285-bc27-0c10a9e86e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.596343 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be07a9-4b66-4ab0-bf6b-044c57097317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.597743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be07a9-4b66-4ab0-bf6b-044c57097317 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.598217 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be07a9-4b66-4ab0-bf6b-044c57097317 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.599287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be07a9-4b66-4ab0-bf6b-044c57097317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.600573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be07a9-4b66-4ab0-bf6b-044c57097317 None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=590ac0c1da06460a8d32852f9c2e3609) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:41.601105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be07a9-4b66-4ab0-bf6b-044c57097317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.603659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be07a9-4b66-4ab0-bf6b-044c57097317 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.618434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 360/700] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/role_assignments?user.id=590ac0c1da06460a8d32852f9c2e3609&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:41.620271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be07a9-4b66-4ab0-bf6b-044c57097317 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.626165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.655576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4e3d0-e70c-4285-bc27-0c10a9e86e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.655576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a4e3d0-e70c-4285-bc27-0c10a9e86e49 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.687941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.779561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 341/701] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:41.780939 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4e3d0-e70c-4285-bc27-0c10a9e86e49 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.831653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be07a9-4b66-4ab0-bf6b-044c57097317 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.900577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296513aa-6c3c-444f-be50-8307d64af6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.901137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296513aa-6c3c-444f-be50-8307d64af6e7 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.901415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296513aa-6c3c-444f-be50-8307d64af6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:41.901684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296513aa-6c3c-444f-be50-8307d64af6e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:41.918481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296513aa-6c3c-444f-be50-8307d64af6e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:41.920121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296513aa-6c3c-444f-be50-8307d64af6e7 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-296513aa-6c3c-444f-be50-8307d64af6e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:41.939029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:41.940011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:41.941544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:41.941544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:41.941544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:41.941544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 361/702] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:41.949787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296513aa-6c3c-444f-be50-8307d64af6e7 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:41.960343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a4e3d0-e70c-4285-bc27-0c10a9e86e49 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:41.988659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:41.998355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30673e2-a2d6-4652-9b77-c98dd6db9d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:41.999331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30673e2-a2d6-4652-9b77-c98dd6db9d37 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:41.999898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30673e2-a2d6-4652-9b77-c98dd6db9d37 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.000454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30673e2-a2d6-4652-9b77-c98dd6db9d37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.013216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30673e2-a2d6-4652-9b77-c98dd6db9d37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.015104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30673e2-a2d6-4652-9b77-c98dd6db9d37 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.016819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-f30673e2-a2d6-4652-9b77-c98dd6db9d37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:42.032172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:42.033156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:42.034069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:42.034069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:42.034069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:42.036879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 342/703] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:42.044756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30673e2-a2d6-4652-9b77-c98dd6db9d37 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.077764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296513aa-6c3c-444f-be50-8307d64af6e7 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.113930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40c378-47fe-4e1b-bd42-bc88bb55bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.114944 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c378-47fe-4e1b-bd42-bc88bb55bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.115419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c378-47fe-4e1b-bd42-bc88bb55bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.115950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce40c378-47fe-4e1b-bd42-bc88bb55bbf7 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.116856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40c378-47fe-4e1b-bd42-bc88bb55bbf7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:42.117353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40c378-47fe-4e1b-bd42-bc88bb55bbf7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.118935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce40c378-47fe-4e1b-bd42-bc88bb55bbf7 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.133060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 362/704] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:42.141288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40c378-47fe-4e1b-bd42-bc88bb55bbf7 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.173122 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30673e2-a2d6-4652-9b77-c98dd6db9d37 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.212403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26d003-e495-48ae-a43e-d20f2cf6f561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.213372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26d003-e495-48ae-a43e-d20f2cf6f561 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.213849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26d003-e495-48ae-a43e-d20f2cf6f561 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.214314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26d003-e495-48ae-a43e-d20f2cf6f561 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.215190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26d003-e495-48ae-a43e-d20f2cf6f561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:42.215712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26d003-e495-48ae-a43e-d20f2cf6f561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.217295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26d003-e495-48ae-a43e-d20f2cf6f561 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.237042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 343/705] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:42.239300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26d003-e495-48ae-a43e-d20f2cf6f561 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.258492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce40c378-47fe-4e1b-bd42-bc88bb55bbf7 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.274268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.292147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.300031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3dee18-0e2f-4397-9065-7171b087a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.301850 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dee18-0e2f-4397-9065-7171b087a9c5 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.302130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dee18-0e2f-4397-9065-7171b087a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.302406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3dee18-0e2f-4397-9065-7171b087a9c5 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.303045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dee18-0e2f-4397-9065-7171b087a9c5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.304511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3dee18-0e2f-4397-9065-7171b087a9c5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.359538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26d003-e495-48ae-a43e-d20f2cf6f561 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.394017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e75544-5807-4540-93ca-ff04d0999719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.394652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e75544-5807-4540-93ca-ff04d0999719 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.394931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e75544-5807-4540-93ca-ff04d0999719 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.395201 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e75544-5807-4540-93ca-ff04d0999719 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.401911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e75544-5807-4540-93ca-ff04d0999719 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.403342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e75544-5807-4540-93ca-ff04d0999719 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.416000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 363/706] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:33:42 2022] POST /identity/v3/users => generated 254 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:42.417467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82922c-b7e1-412c-9751-30cae5b86a2b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.417767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82922c-b7e1-412c-9751-30cae5b86a2b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.418119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f82922c-b7e1-412c-9751-30cae5b86a2b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-f5e75544-5807-4540-93ca-ff04d0999719 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:42.418909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:42.419837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:42.420758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:42.420758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:42.420758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:42.420758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:42.420758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:42.420758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:42.420758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:42.420758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:42.423300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 344/708] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:42.423437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 364/708] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:42.427036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4d004-686f-437d-aa6c-17076e855735 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.427418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4d004-686f-437d-aa6c-17076e855735 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.427716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4d004-686f-437d-aa6c-17076e855735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.429198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e75544-5807-4540-93ca-ff04d0999719 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.449676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-e6f4d004-686f-437d-aa6c-17076e855735 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:42.451446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e6f4d004-686f-437d-aa6c-17076e855735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:42.599660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 365/709] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:42.615123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:42.618094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e75544-5807-4540-93ca-ff04d0999719 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.669530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04658-1c5b-4897-b227-13dbaf2a7d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.670135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04658-1c5b-4897-b227-13dbaf2a7d97 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.670411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04658-1c5b-4897-b227-13dbaf2a7d97 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.670677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a04658-1c5b-4897-b227-13dbaf2a7d97 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.671366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a04658-1c5b-4897-b227-13dbaf2a7d97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:42.671698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a04658-1c5b-4897-b227-13dbaf2a7d97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.673118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a04658-1c5b-4897-b227-13dbaf2a7d97 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.686184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cede3-4d09-4c9d-8e9f-545524e64d14 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.686595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 345/710] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:42.686963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cede3-4d09-4c9d-8e9f-545524e64d14 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.687309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68cede3-4d09-4c9d-8e9f-545524e64d14 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.691559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 366/711] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:42.692692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04658-1c5b-4897-b227-13dbaf2a7d97 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.695993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37de2a4-5297-4fde-aef7-5d8d90e98fb8 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.696215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37de2a4-5297-4fde-aef7-5d8d90e98fb8 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.696496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37de2a4-5297-4fde-aef7-5d8d90e98fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.715475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-e37de2a4-5297-4fde-aef7-5d8d90e98fb8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:42.716721 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e37de2a4-5297-4fde-aef7-5d8d90e98fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:42.800490 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 367/712] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:42.815255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a04658-1c5b-4897-b227-13dbaf2a7d97 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:42.851346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258979fd-324f-4982-9a16-88cace0c78b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:42.852016 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258979fd-324f-4982-9a16-88cace0c78b8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:42.852281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258979fd-324f-4982-9a16-88cace0c78b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:42.852544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258979fd-324f-4982-9a16-88cace0c78b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:42.853280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258979fd-324f-4982-9a16-88cace0c78b8 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=e05901861bc34c2398ec600150296657) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:42.862428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258979fd-324f-4982-9a16-88cace0c78b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:42.862428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258979fd-324f-4982-9a16-88cace0c78b8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:42.862428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 346/713] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/role_assignments?user.id=e05901861bc34c2398ec600150296657&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:42.929891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37de2a4-5297-4fde-aef7-5d8d90e98fb8 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:42.965635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.043311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37de2a4-5297-4fde-aef7-5d8d90e98fb8 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.079485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd3ab-4962-4e21-9bba-14673590de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.080172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd3ab-4962-4e21-9bba-14673590de28 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.080456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd3ab-4962-4e21-9bba-14673590de28 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.080735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31dd3ab-4962-4e21-9bba-14673590de28 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.081344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd3ab-4962-4e21-9bba-14673590de28 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.083323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31dd3ab-4962-4e21-9bba-14673590de28 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-b31dd3ab-4962-4e21-9bba-14673590de28 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:43.095085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:43.096220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:43.097197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:43.101290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 368/714] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Oct 4 08:33:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:43.102681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258979fd-324f-4982-9a16-88cace0c78b8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.110925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd3ab-4962-4e21-9bba-14673590de28 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.134412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.229902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258979fd-324f-4982-9a16-88cace0c78b8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.336313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31dd3ab-4962-4e21-9bba-14673590de28 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.339918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.360798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c626f-9b22-4a7d-85d3-ee831add29e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.361428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c626f-9b22-4a7d-85d3-ee831add29e8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.361704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c626f-9b22-4a7d-85d3-ee831add29e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.361976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c626f-9b22-4a7d-85d3-ee831add29e8 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.363126 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c626f-9b22-4a7d-85d3-ee831add29e8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:43.363439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c626f-9b22-4a7d-85d3-ee831add29e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.364847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3c626f-9b22-4a7d-85d3-ee831add29e8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.373135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792e62b-edd5-4d84-b4f4-d6bb24e0f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.373772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792e62b-edd5-4d84-b4f4-d6bb24e0f31d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.374057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792e62b-edd5-4d84-b4f4-d6bb24e0f31d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.374329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792e62b-edd5-4d84-b4f4-d6bb24e0f31d None admin] PATH_INFO: `/v3/services/network` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.374920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792e62b-edd5-4d84-b4f4-d6bb24e0f31d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.376488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792e62b-edd5-4d84-b4f4-d6bb24e0f31d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.382146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 347/715] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-7792e62b-edd5-4d84-b4f4-d6bb24e0f31d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:43.389835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:43.390832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:43.391740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:43.393021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 369/716] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/services/network => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:43.394192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c626f-9b22-4a7d-85d3-ee831add29e8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.399712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792e62b-edd5-4d84-b4f4-d6bb24e0f31d None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.554790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.565667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792e62b-edd5-4d84-b4f4-d6bb24e0f31d None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.588567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c626f-9b22-4a7d-85d3-ee831add29e8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.641181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4855f-4ae6-436a-9030-df7769571f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.642176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4855f-4ae6-436a-9030-df7769571f67 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.642658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4855f-4ae6-436a-9030-df7769571f67 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.643129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4855f-4ae6-436a-9030-df7769571f67 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.644022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4855f-4ae6-436a-9030-df7769571f67 None admin] RBAC: Adding query filter params (name=network) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:43.645730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4855f-4ae6-436a-9030-df7769571f67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.647304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4855f-4ae6-436a-9030-df7769571f67 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.657335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d93f12-3ef7-453f-a3bf-52f26d48165a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.658270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93f12-3ef7-453f-a3bf-52f26d48165a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.658704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 370/717] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:43.664012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93f12-3ef7-453f-a3bf-52f26d48165a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.665124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4855f-4ae6-436a-9030-df7769571f67 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:43.665610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d93f12-3ef7-453f-a3bf-52f26d48165a None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.666467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d93f12-3ef7-453f-a3bf-52f26d48165a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:43.667809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d93f12-3ef7-453f-a3bf-52f26d48165a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.671212 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d93f12-3ef7-453f-a3bf-52f26d48165a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.686007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 348/718] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:43.715710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:43.836832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4855f-4ae6-436a-9030-df7769571f67 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:43.895387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb4856-10e5-4d16-9cc2-bc0e941dad46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:43.896020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb4856-10e5-4d16-9cc2-bc0e941dad46 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:43.896297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb4856-10e5-4d16-9cc2-bc0e941dad46 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:43.896568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb4856-10e5-4d16-9cc2-bc0e941dad46 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:43.897201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb4856-10e5-4d16-9cc2-bc0e941dad46 None admin] RBAC: Adding query filter params (type=network) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:43.897502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb4856-10e5-4d16-9cc2-bc0e941dad46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:43.898856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb4856-10e5-4d16-9cc2-bc0e941dad46 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:43.905838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 371/719] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:33:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:44.696726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9313-fa78-45fc-b1e8-12e8691feefd None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:44.697746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9313-fa78-45fc-b1e8-12e8691feefd None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:44.698241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d9313-fa78-45fc-b1e8-12e8691feefd None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:44.700157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 349/720] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:44.705969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec416548-e99f-428c-b84d-8971a24b3c09 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:44.706987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec416548-e99f-428c-b84d-8971a24b3c09 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:44.707192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec416548-e99f-428c-b84d-8971a24b3c09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:44.728724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ec416548-e99f-428c-b84d-8971a24b3c09 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:44.729903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ec416548-e99f-428c-b84d-8971a24b3c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:44.826452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 372/721] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:45.252888 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10037b-bd71-4726-9f94-b9946cde3e31 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.253301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10037b-bd71-4726-9f94-b9946cde3e31 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.253483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b10037b-bd71-4726-9f94-b9946cde3e31 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.255040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 350/722] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:45.260427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0340ab-4007-4e1c-ba90-b936e102e183 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.261005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0340ab-4007-4e1c-ba90-b936e102e183 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.261492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0340ab-4007-4e1c-ba90-b936e102e183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.285396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9f0340ab-4007-4e1c-ba90-b936e102e183 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:45.287081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9f0340ab-4007-4e1c-ba90-b936e102e183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:45.305410 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:45.334662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10037b-bd71-4726-9f94-b9946cde3e31 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:45.374675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 373/723] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:45.413990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb55e6-8c77-4254-9436-5effc0b7b474 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.414295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb55e6-8c77-4254-9436-5effc0b7b474 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.414541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb55e6-8c77-4254-9436-5effc0b7b474 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.416244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 374/724] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:45.421257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19604c-417e-4a1b-8b1a-7de98e0dc9b6 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.421540 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19604c-417e-4a1b-8b1a-7de98e0dc9b6 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.421867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19604c-417e-4a1b-8b1a-7de98e0dc9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.441546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-0b19604c-417e-4a1b-8b1a-7de98e0dc9b6 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:45.442717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0b19604c-417e-4a1b-8b1a-7de98e0dc9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:45.545597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b10037b-bd71-4726-9f94-b9946cde3e31 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:45.562639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 375/725] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 04 08:33:45.623089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa0b68-d7cb-45a1-8e1a-34ec0bef188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:45.623770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa0b68-d7cb-45a1-8e1a-34ec0bef188e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.624043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa0b68-d7cb-45a1-8e1a-34ec0bef188e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.624312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa0b68-d7cb-45a1-8e1a-34ec0bef188e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.640409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa0b68-d7cb-45a1-8e1a-34ec0bef188e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-15aa0b68-d7cb-45a1-8e1a-34ec0bef188e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:45.645673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:45.646593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:45.647850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 351/726] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:45.654684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19604c-417e-4a1b-8b1a-7de98e0dc9b6 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:45.725827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa0b68-d7cb-45a1-8e1a-34ec0bef188e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:45.747745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:45.801997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:45.833319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19604c-417e-4a1b-8b1a-7de98e0dc9b6 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:45.893375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4f6c9-fce1-4e70-bf1a-2f12a603aefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:45.894475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa0b68-d7cb-45a1-8e1a-34ec0bef188e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:45.895107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4f6c9-fce1-4e70-bf1a-2f12a603aefb None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.895673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4f6c9-fce1-4e70-bf1a-2f12a603aefb None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.896377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f4f6c9-fce1-4e70-bf1a-2f12a603aefb None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.897342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4f6c9-fce1-4e70-bf1a-2f12a603aefb None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:45.897854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4f6c9-fce1-4e70-bf1a-2f12a603aefb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:45.899434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f4f6c9-fce1-4e70-bf1a-2f12a603aefb None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:45.908828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 376/727] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:45.910539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4f6c9-fce1-4e70-bf1a-2f12a603aefb None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:45.944044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00bd51-4d61-47f6-befc-5dbda81084d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:45.944847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00bd51-4d61-47f6-befc-5dbda81084d2 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:45.945133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00bd51-4d61-47f6-befc-5dbda81084d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:45.945416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b00bd51-4d61-47f6-befc-5dbda81084d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:45.959019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b00bd51-4d61-47f6-befc-5dbda81084d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-1b00bd51-4d61-47f6-befc-5dbda81084d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:45.965705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:45.966668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:45.967580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 352/728] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:45.968278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00bd51-4d61-47f6-befc-5dbda81084d2 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.035474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f4f6c9-fce1-4e70-bf1a-2f12a603aefb None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.049694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.079842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5b25-4c48-44e8-ad7d-d994cc229b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.080340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5b25-4c48-44e8-ad7d-d994cc229b86 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.080621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5b25-4c48-44e8-ad7d-d994cc229b86 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.080904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223e5b25-4c48-44e8-ad7d-d994cc229b86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.085435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b00bd51-4d61-47f6-befc-5dbda81084d2 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.089921 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.093987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223e5b25-4c48-44e8-ad7d-d994cc229b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-223e5b25-4c48-44e8-ad7d-d994cc229b86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:46.100354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:46.107501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 377/729] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:46.108404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5b25-4c48-44e8-ad7d-d994cc229b86 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.133819 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb753f93-0350-4c83-b4ec-414178a6719e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.134872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb753f93-0350-4c83-b4ec-414178a6719e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.135392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb753f93-0350-4c83-b4ec-414178a6719e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.135925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb753f93-0350-4c83-b4ec-414178a6719e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.148697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb753f93-0350-4c83-b4ec-414178a6719e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.150510 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb753f93-0350-4c83-b4ec-414178a6719e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-fb753f93-0350-4c83-b4ec-414178a6719e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:46.167017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:46.168040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:46.168952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:46.168952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:46.168952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:46.171214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 353/730] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:46.172251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb753f93-0350-4c83-b4ec-414178a6719e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.233361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223e5b25-4c48-44e8-ad7d-d994cc229b86 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.276750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2251966-1944-4430-abaa-c4873d115fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.277371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2251966-1944-4430-abaa-c4873d115fb8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.277659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2251966-1944-4430-abaa-c4873d115fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.277937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2251966-1944-4430-abaa-c4873d115fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.278903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2251966-1944-4430-abaa-c4873d115fb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:46.279212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2251966-1944-4430-abaa-c4873d115fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.280807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2251966-1944-4430-abaa-c4873d115fb8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.295464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 378/731] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:46.295464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2251966-1944-4430-abaa-c4873d115fb8 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.303007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb753f93-0350-4c83-b4ec-414178a6719e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.328758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.339960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c79c6-1c6e-4d6c-9fa0-302e6a597546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.340440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c79c6-1c6e-4d6c-9fa0-302e6a597546 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.340715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c79c6-1c6e-4d6c-9fa0-302e6a597546 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.341037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c79c6-1c6e-4d6c-9fa0-302e6a597546 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.341638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c79c6-1c6e-4d6c-9fa0-302e6a597546 None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:46.341936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c79c6-1c6e-4d6c-9fa0-302e6a597546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.343837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c79c6-1c6e-4d6c-9fa0-302e6a597546 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.352044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 354/732] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:46.365635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c79c6-1c6e-4d6c-9fa0-302e6a597546 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.365757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.403528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2251966-1944-4430-abaa-c4873d115fb8 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.437846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb88e73-ce15-4a7a-9d8d-c9464868d62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.438447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb88e73-ce15-4a7a-9d8d-c9464868d62c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.438725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb88e73-ce15-4a7a-9d8d-c9464868d62c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.438992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb88e73-ce15-4a7a-9d8d-c9464868d62c None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.439656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb88e73-ce15-4a7a-9d8d-c9464868d62c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:46.439959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb88e73-ce15-4a7a-9d8d-c9464868d62c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.441947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb88e73-ce15-4a7a-9d8d-c9464868d62c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.454031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 379/733] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:46.455309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e9c1f-35f1-442b-8b98-2dbf0d9d6e91 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.455629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e9c1f-35f1-442b-8b98-2dbf0d9d6e91 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.455908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e9c1f-35f1-442b-8b98-2dbf0d9d6e91 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.457305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 380/734] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:46.457899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e9c1f-35f1-442b-8b98-2dbf0d9d6e91 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.481669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c79c6-1c6e-4d6c-9fa0-302e6a597546 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.519095 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305036c-452f-447a-93d9-a4392100aae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.520044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305036c-452f-447a-93d9-a4392100aae5 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.520479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305036c-452f-447a-93d9-a4392100aae5 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.520754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305036c-452f-447a-93d9-a4392100aae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.531168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305036c-452f-447a-93d9-a4392100aae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.532636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305036c-452f-447a-93d9-a4392100aae5 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-d305036c-452f-447a-93d9-a4392100aae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:46.546946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:46.547949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:46.548868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:46.548868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:46.548868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:46.548868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 355/735] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:46.549450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923f12-8c03-4436-8a8b-37f418e3fe7b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.549534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923f12-8c03-4436-8a8b-37f418e3fe7b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.549879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5923f12-8c03-4436-8a8b-37f418e3fe7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.568902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-d5923f12-8c03-4436-8a8b-37f418e3fe7b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:46.570091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d5923f12-8c03-4436-8a8b-37f418e3fe7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:46.577371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3e9c1f-35f1-442b-8b98-2dbf0d9d6e91 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.602683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.604807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.617318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8f1c7-c6be-41e6-9808-cee9b7ec19d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.617946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8f1c7-c6be-41e6-9808-cee9b7ec19d2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.618227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8f1c7-c6be-41e6-9808-cee9b7ec19d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.618504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8f1c7-c6be-41e6-9808-cee9b7ec19d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.628931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8f1c7-c6be-41e6-9808-cee9b7ec19d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.630354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8f1c7-c6be-41e6-9808-cee9b7ec19d2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.642115 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 356/736] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:46.642937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5923f12-8c03-4436-8a8b-37f418e3fe7b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-a7c8f1c7-c6be-41e6-9808-cee9b7ec19d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:46.645014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:46.645913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:46.646821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:46.646821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:46.646821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:46.646821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 381/737] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:46.646821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8f1c7-c6be-41e6-9808-cee9b7ec19d2 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.749446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5923f12-8c03-4436-8a8b-37f418e3fe7b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.753573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8f1c7-c6be-41e6-9808-cee9b7ec19d2 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.789066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b176c5b-79b3-46a7-80cc-f9323cadbbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.789728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b176c5b-79b3-46a7-80cc-f9323cadbbfd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.790008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b176c5b-79b3-46a7-80cc-f9323cadbbfd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.790278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b176c5b-79b3-46a7-80cc-f9323cadbbfd None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.790863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46849-4e85-4f1a-b197-05847604aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.790982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b176c5b-79b3-46a7-80cc-f9323cadbbfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:46.791210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b176c5b-79b3-46a7-80cc-f9323cadbbfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.791497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46849-4e85-4f1a-b197-05847604aebb None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.791805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46849-4e85-4f1a-b197-05847604aebb None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.792081 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a46849-4e85-4f1a-b197-05847604aebb None admin] PATH_INFO: `/v3/users/swift` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.792601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b176c5b-79b3-46a7-80cc-f9323cadbbfd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.799930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a46849-4e85-4f1a-b197-05847604aebb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.802407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a46849-4e85-4f1a-b197-05847604aebb None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.810255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 382/738] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:46.810255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89575087-d977-465a-afed-b218c94b53b3 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.810255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89575087-d977-465a-afed-b218c94b53b3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.810255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89575087-d977-465a-afed-b218c94b53b3 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.812756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 383/739] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:46.813738 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89575087-d977-465a-afed-b218c94b53b3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.848761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.924783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89575087-d977-465a-afed-b218c94b53b3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-49a46849-4e85-4f1a-b197-05847604aebb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:46.926962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:46.928057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 357/740] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:46.928983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46849-4e85-4f1a-b197-05847604aebb None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:46.956356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:46.961612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e50dc53-d09e-4ddc-92bd-d5aafcfbd8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:46.962271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50dc53-d09e-4ddc-92bd-d5aafcfbd8d8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.962549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50dc53-d09e-4ddc-92bd-d5aafcfbd8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.968185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e50dc53-d09e-4ddc-92bd-d5aafcfbd8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.968185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50dc53-d09e-4ddc-92bd-d5aafcfbd8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:46.968185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50dc53-d09e-4ddc-92bd-d5aafcfbd8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:46.968185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e50dc53-d09e-4ddc-92bd-d5aafcfbd8d8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:46.976461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 384/741] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:46.977436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9835d-ce5e-4a0a-86ba-9205392a1638 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:46.977718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9835d-ce5e-4a0a-86ba-9205392a1638 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:46.977990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9835d-ce5e-4a0a-86ba-9205392a1638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:46.995367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-eaa9835d-ce5e-4a0a-86ba-9205392a1638 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:46.996599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-eaa9835d-ce5e-4a0a-86ba-9205392a1638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:47.028508 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a46849-4e85-4f1a-b197-05847604aebb None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.059986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 385/742] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 04 08:33:47.060765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9835d-ce5e-4a0a-86ba-9205392a1638 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.060869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9569d-51f9-48bf-b314-64b2ec704745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.061413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9569d-51f9-48bf-b314-64b2ec704745 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.061688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9569d-51f9-48bf-b314-64b2ec704745 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.061964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc9569d-51f9-48bf-b314-64b2ec704745 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.068792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9569d-51f9-48bf-b314-64b2ec704745 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.070197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc9569d-51f9-48bf-b314-64b2ec704745 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-2bc9569d-51f9-48bf-b314-64b2ec704745 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:47.084538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:47.085567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 358/743] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:47.086516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9569d-51f9-48bf-b314-64b2ec704745 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.100759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.172588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.185103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9835d-ce5e-4a0a-86ba-9205392a1638 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.187573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc9569d-51f9-48bf-b314-64b2ec704745 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.219231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb956e8a-84aa-48d3-a4b9-564820d4bc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.219859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb956e8a-84aa-48d3-a4b9-564820d4bc67 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.220144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb956e8a-84aa-48d3-a4b9-564820d4bc67 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.220421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb956e8a-84aa-48d3-a4b9-564820d4bc67 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.221065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb956e8a-84aa-48d3-a4b9-564820d4bc67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.222984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb956e8a-84aa-48d3-a4b9-564820d4bc67 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.225103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ab99a-1a8c-4077-aced-a5c6a39470df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.225698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ab99a-1a8c-4077-aced-a5c6a39470df None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.225972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ab99a-1a8c-4077-aced-a5c6a39470df None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.226277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ab99a-1a8c-4077-aced-a5c6a39470df None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.226956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ab99a-1a8c-4077-aced-a5c6a39470df None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:47.227257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ab99a-1a8c-4077-aced-a5c6a39470df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.228728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ab99a-1a8c-4077-aced-a5c6a39470df None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.245161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 359/744] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:47.245942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ab99a-1a8c-4077-aced-a5c6a39470df None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.307294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 386/745] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:33:47 2022] POST /identity/v3/services => generated 251 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:47.308576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb956e8a-84aa-48d3-a4b9-564820d4bc67 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.353967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ab99a-1a8c-4077-aced-a5c6a39470df None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.406583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd07033-746c-4ab0-816b-a298b0b11946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.407242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd07033-746c-4ab0-816b-a298b0b11946 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.407602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd07033-746c-4ab0-816b-a298b0b11946 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.407877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd07033-746c-4ab0-816b-a298b0b11946 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.415399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.416571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd07033-746c-4ab0-816b-a298b0b11946 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.418040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd07033-746c-4ab0-816b-a298b0b11946 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.421645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-ecd07033-746c-4ab0-816b-a298b0b11946 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:47.431399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:47.432434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 360/746] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:47.433484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd07033-746c-4ab0-816b-a298b0b11946 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.442491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb956e8a-84aa-48d3-a4b9-564820d4bc67 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.485146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e98b03-9449-441c-9fb3-72b51a03f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.485765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e98b03-9449-441c-9fb3-72b51a03f578 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.486048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e98b03-9449-441c-9fb3-72b51a03f578 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.486321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e98b03-9449-441c-9fb3-72b51a03f578 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.487046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e98b03-9449-441c-9fb3-72b51a03f578 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:47.487351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e98b03-9449-441c-9fb3-72b51a03f578 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.488829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e98b03-9449-441c-9fb3-72b51a03f578 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.510893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 387/747] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:47.512025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e98b03-9449-441c-9fb3-72b51a03f578 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.553743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd07033-746c-4ab0-816b-a298b0b11946 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.592020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a788aaf-339f-42ed-9bbe-1f55d0efa0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.592627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a788aaf-339f-42ed-9bbe-1f55d0efa0ae None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.592905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a788aaf-339f-42ed-9bbe-1f55d0efa0ae None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.593184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a788aaf-339f-42ed-9bbe-1f55d0efa0ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.621924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e98b03-9449-441c-9fb3-72b51a03f578 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.661458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb0911-6609-403d-bf35-a8ba979d49fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.661767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.662096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb0911-6609-403d-bf35-a8ba979d49fd None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.662384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb0911-6609-403d-bf35-a8ba979d49fd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.662658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb0911-6609-403d-bf35-a8ba979d49fd None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.663463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb0911-6609-403d-bf35-a8ba979d49fd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.664692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a788aaf-339f-42ed-9bbe-1f55d0efa0ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.664801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb0911-6609-403d-bf35-a8ba979d49fd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.666102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a788aaf-339f-42ed-9bbe-1f55d0efa0ae None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.719200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.732012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 388/748] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:33:47 2022] POST /identity/v3/services => generated 240 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:47.733009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb0911-6609-403d-bf35-a8ba979d49fd None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.782303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 361/749] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 04 08:33:47.783332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a788aaf-339f-42ed-9bbe-1f55d0efa0ae None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.904064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb0911-6609-403d-bf35-a8ba979d49fd None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.905567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a788aaf-339f-42ed-9bbe-1f55d0efa0ae None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:47.908769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:47.946639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0c3d-2b04-4891-b52d-99bee6ccd119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.947249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0c3d-2b04-4891-b52d-99bee6ccd119 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.947571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0c3d-2b04-4891-b52d-99bee6ccd119 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.948623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb0c3d-2b04-4891-b52d-99bee6ccd119 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.948623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb0c3d-2b04-4891-b52d-99bee6ccd119 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:47.948953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb0c3d-2b04-4891-b52d-99bee6ccd119 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.950356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb0c3d-2b04-4891-b52d-99bee6ccd119 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.954941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae39236-8016-40e1-949b-51297314a527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:47.956071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae39236-8016-40e1-949b-51297314a527 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:47.956071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae39236-8016-40e1-949b-51297314a527 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:47.956288 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae39236-8016-40e1-949b-51297314a527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:47.966262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae39236-8016-40e1-949b-51297314a527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:47.967743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae39236-8016-40e1-949b-51297314a527 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:47.972109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 389/750] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:47.973292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0c3d-2b04-4891-b52d-99bee6ccd119 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-9ae39236-8016-40e1-949b-51297314a527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:47.993730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:47.994755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:47.995667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:47.995667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:47.995667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:47.996346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 362/751] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:47.996903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae39236-8016-40e1-949b-51297314a527 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.034428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.084542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb0c3d-2b04-4891-b52d-99bee6ccd119 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.124166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809148a5-ffbb-43d5-90ca-d2ee77960df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.125076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809148a5-ffbb-43d5-90ca-d2ee77960df6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.125505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809148a5-ffbb-43d5-90ca-d2ee77960df6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.125896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae39236-8016-40e1-949b-51297314a527 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.126077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809148a5-ffbb-43d5-90ca-d2ee77960df6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.138961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809148a5-ffbb-43d5-90ca-d2ee77960df6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.140802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809148a5-ffbb-43d5-90ca-d2ee77960df6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-809148a5-ffbb-43d5-90ca-d2ee77960df6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:48.156537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:48.157504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:48.158404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:48.158404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.158404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:48.161148 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 390/752] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:48.162225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809148a5-ffbb-43d5-90ca-d2ee77960df6 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.169771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d252e62-cbc4-4a9a-93a2-58f5439bc379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.170381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252e62-cbc4-4a9a-93a2-58f5439bc379 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.170655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252e62-cbc4-4a9a-93a2-58f5439bc379 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.170925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d252e62-cbc4-4a9a-93a2-58f5439bc379 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.196768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.252048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d252e62-cbc4-4a9a-93a2-58f5439bc379 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.253540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d252e62-cbc4-4a9a-93a2-58f5439bc379 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.280054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809148a5-ffbb-43d5-90ca-d2ee77960df6 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.295849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.327290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85441c13-6e3a-4d5a-aeb6-c331ce72bd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.328218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85441c13-6e3a-4d5a-aeb6-c331ce72bd96 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.328500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85441c13-6e3a-4d5a-aeb6-c331ce72bd96 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.328792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85441c13-6e3a-4d5a-aeb6-c331ce72bd96 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.329444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85441c13-6e3a-4d5a-aeb6-c331ce72bd96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:48.329747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85441c13-6e3a-4d5a-aeb6-c331ce72bd96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.332453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85441c13-6e3a-4d5a-aeb6-c331ce72bd96 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.349494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 391/753] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:48.350403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85441c13-6e3a-4d5a-aeb6-c331ce72bd96 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.387937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 363/754] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:33:48.389110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d252e62-cbc4-4a9a-93a2-58f5439bc379 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.452672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85441c13-6e3a-4d5a-aeb6-c331ce72bd96 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.457147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.489016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd21497-55dc-406d-95a6-ecfa6678b20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.489633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd21497-55dc-406d-95a6-ecfa6678b20b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.489917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd21497-55dc-406d-95a6-ecfa6678b20b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.490193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd21497-55dc-406d-95a6-ecfa6678b20b None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.490912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd21497-55dc-406d-95a6-ecfa6678b20b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:48.491434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd21497-55dc-406d-95a6-ecfa6678b20b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.492687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd21497-55dc-406d-95a6-ecfa6678b20b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.508843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 392/755] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:48.509840 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd21497-55dc-406d-95a6-ecfa6678b20b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.516824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d252e62-cbc4-4a9a-93a2-58f5439bc379 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.544306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.554798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d852048-fe57-4ecb-b6f7-74928abddf41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.554798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d852048-fe57-4ecb-b6f7-74928abddf41 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.555073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d852048-fe57-4ecb-b6f7-74928abddf41 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.555311 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d852048-fe57-4ecb-b6f7-74928abddf41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.562864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d852048-fe57-4ecb-b6f7-74928abddf41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.564415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d852048-fe57-4ecb-b6f7-74928abddf41 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-0d852048-fe57-4ecb-b6f7-74928abddf41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:48.582543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:48.583707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:48.584713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:48.584713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:48.584713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:48.584713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:48.584713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:48.584713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:48.584713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:48.584713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:48.584713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 364/756] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:48.585302 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d852048-fe57-4ecb-b6f7-74928abddf41 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.641402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd21497-55dc-406d-95a6-ecfa6678b20b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.686161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f06b14-4a33-49ee-84ba-ef09435426d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.687303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f06b14-4a33-49ee-84ba-ef09435426d4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.687782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f06b14-4a33-49ee-84ba-ef09435426d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.688446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f06b14-4a33-49ee-84ba-ef09435426d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.699405 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d852048-fe57-4ecb-b6f7-74928abddf41 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.703780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f06b14-4a33-49ee-84ba-ef09435426d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.705552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f06b14-4a33-49ee-84ba-ef09435426d4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.715889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-a2f06b14-4a33-49ee-84ba-ef09435426d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:48.728791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:48.733290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:48.734365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:48.734365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:48.734365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:48.734365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 393/757] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:48.734365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f06b14-4a33-49ee-84ba-ef09435426d4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.743603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df7ecf-3324-4753-812d-4c0164054fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.744306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df7ecf-3324-4753-812d-4c0164054fdd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.744595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df7ecf-3324-4753-812d-4c0164054fdd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.744928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df7ecf-3324-4753-812d-4c0164054fdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.753983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df7ecf-3324-4753-812d-4c0164054fdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.756246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df7ecf-3324-4753-812d-4c0164054fdd None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-71df7ecf-3324-4753-812d-4c0164054fdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:48.771330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:48.772248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:48.773136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:48.773136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:48.773136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:48.773136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:48.773136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:48.773136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:48.773136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:48.773136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:48.773136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 365/758] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:48.773730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df7ecf-3324-4753-812d-4c0164054fdd None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.830046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:48.852376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f06b14-4a33-49ee-84ba-ef09435426d4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.886538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6438-ddf5-4099-a31c-14c314e06834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.887191 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6438-ddf5-4099-a31c-14c314e06834 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.887615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6438-ddf5-4099-a31c-14c314e06834 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.887971 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea6438-ddf5-4099-a31c-14c314e06834 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.888766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea6438-ddf5-4099-a31c-14c314e06834 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:48.889171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea6438-ddf5-4099-a31c-14c314e06834 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.890690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfea6438-ddf5-4099-a31c-14c314e06834 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.897222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df7ecf-3324-4753-812d-4c0164054fdd None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:48.904450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 394/759] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:48.905420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6438-ddf5-4099-a31c-14c314e06834 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.938692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e1010-4963-4ea5-897b-552aac675e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:48.939560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e1010-4963-4ea5-897b-552aac675e7d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:48.939981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e1010-4963-4ea5-897b-552aac675e7d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:48.940394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e1010-4963-4ea5-897b-552aac675e7d None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:48.941705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e1010-4963-4ea5-897b-552aac675e7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:48.942187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e1010-4963-4ea5-897b-552aac675e7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:48.943707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e1010-4963-4ea5-897b-552aac675e7d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:48.958282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 366/760] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:48.959323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e1010-4963-4ea5-897b-552aac675e7d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:48.996988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.015205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea6438-ddf5-4099-a31c-14c314e06834 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.055812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3f32d-4678-4876-b387-22fdd22a322f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.056823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f32d-4678-4876-b387-22fdd22a322f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.057254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f32d-4678-4876-b387-22fdd22a322f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.057983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe3f32d-4678-4876-b387-22fdd22a322f None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.058828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3f32d-4678-4876-b387-22fdd22a322f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:49.059255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3f32d-4678-4876-b387-22fdd22a322f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.060989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe3f32d-4678-4876-b387-22fdd22a322f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.070761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.078876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 395/761] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:49.079744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3f32d-4678-4876-b387-22fdd22a322f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.081795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e1010-4963-4ea5-897b-552aac675e7d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.125346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293f563-20ad-4e67-8739-752b3f5dd522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.126037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293f563-20ad-4e67-8739-752b3f5dd522 None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.126318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293f563-20ad-4e67-8739-752b3f5dd522 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.126594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0293f563-20ad-4e67-8739-752b3f5dd522 None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/e05901861bc34c2398ec600150296657/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.129166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293f563-20ad-4e67-8739-752b3f5dd522 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=e05901861bc34c2398ec600150296657, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.130639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0293f563-20ad-4e67-8739-752b3f5dd522 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.192343 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe3f32d-4678-4876-b387-22fdd22a322f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.216154 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 367/762] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:48 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/e05901861bc34c2398ec600150296657/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:49.217955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293f563-20ad-4e67-8739-752b3f5dd522 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.228175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff4dcf-0bdb-4624-8302-fdce1a10e077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.228880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff4dcf-0bdb-4624-8302-fdce1a10e077 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.229196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff4dcf-0bdb-4624-8302-fdce1a10e077 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.229468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff4dcf-0bdb-4624-8302-fdce1a10e077 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.248828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff4dcf-0bdb-4624-8302-fdce1a10e077 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.250319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff4dcf-0bdb-4624-8302-fdce1a10e077 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-13ff4dcf-0bdb-4624-8302-fdce1a10e077 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:49.272297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:49.273289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:49.274197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:49.274197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:49.274197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:49.274197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:49.274197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:49.274197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:49.274197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:49.274197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:49.274197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 396/763] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:49.280804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff4dcf-0bdb-4624-8302-fdce1a10e077 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.377131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.393386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:49.405786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0293f563-20ad-4e67-8739-752b3f5dd522 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.446804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff4dcf-0bdb-4624-8302-fdce1a10e077 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.486968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73f71-d89e-4160-beb1-0bef2410ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.487624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73f71-d89e-4160-beb1-0bef2410ff97 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.488011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73f71-d89e-4160-beb1-0bef2410ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.488263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f73f71-d89e-4160-beb1-0bef2410ff97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.489066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f73f71-d89e-4160-beb1-0bef2410ff97 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=590ac0c1da06460a8d32852f9c2e3609) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:49.489376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f73f71-d89e-4160-beb1-0bef2410ff97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.490842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f73f71-d89e-4160-beb1-0bef2410ff97 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.497492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ff344-8b92-4d83-8808-cf04aeed3eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.497713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 368/764] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/role_assignments?user.id=590ac0c1da06460a8d32852f9c2e3609&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:49.498573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff344-8b92-4d83-8808-cf04aeed3eca None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.499057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff344-8b92-4d83-8808-cf04aeed3eca None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.499640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ff344-8b92-4d83-8808-cf04aeed3eca None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.500592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff344-8b92-4d83-8808-cf04aeed3eca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:49.501173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff344-8b92-4d83-8808-cf04aeed3eca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.502979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ff344-8b92-4d83-8808-cf04aeed3eca None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.517923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 397/765] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:49.524947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73f71-d89e-4160-beb1-0bef2410ff97 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:49.608807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97a06-1a73-4b19-9c45-067b0136cbcc None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.609137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97a06-1a73-4b19-9c45-067b0136cbcc None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.609360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b97a06-1a73-4b19-9c45-067b0136cbcc None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.611046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 398/766] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:49.616941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a69d74-c05e-4411-91e7-6bb6fd731795 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.617253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a69d74-c05e-4411-91e7-6bb6fd731795 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.617502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a69d74-c05e-4411-91e7-6bb6fd731795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.637360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f1a69d74-c05e-4411-91e7-6bb6fd731795 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:49.638489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f1a69d74-c05e-4411-91e7-6bb6fd731795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:49.644943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f73f71-d89e-4160-beb1-0bef2410ff97 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:49.693964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b266f-0f96-4ee8-9b43-c24198e5b22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:49.694953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b266f-0f96-4ee8-9b43-c24198e5b22e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:49.695454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b266f-0f96-4ee8-9b43-c24198e5b22e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:49.696251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06b266f-0f96-4ee8-9b43-c24198e5b22e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:49.697767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b266f-0f96-4ee8-9b43-c24198e5b22e None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=c429ad73f92e4f6d995198189b64406b) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:49.698602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b266f-0f96-4ee8-9b43-c24198e5b22e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:49.700556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06b266f-0f96-4ee8-9b43-c24198e5b22e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:49.710281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 369/767] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/role_assignments?user.id=c429ad73f92e4f6d995198189b64406b&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:49.720860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 399/768] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:33:50.000401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b266f-0f96-4ee8-9b43-c24198e5b22e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.024228 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.118717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06b266f-0f96-4ee8-9b43-c24198e5b22e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.147067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907ada-77fc-49de-b9e9-aff5cd9f44d4 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.147591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907ada-77fc-49de-b9e9-aff5cd9f44d4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.147670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f907ada-77fc-49de-b9e9-aff5cd9f44d4 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.149283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 400/769] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:50.156684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69704383-382f-4b34-a365-afceb40ecd36 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.156967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69704383-382f-4b34-a365-afceb40ecd36 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.157071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaf8c3-7380-49d5-b8b2-331ce94f70e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.157249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69704383-382f-4b34-a365-afceb40ecd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.157687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf8c3-7380-49d5-b8b2-331ce94f70e6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.157965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf8c3-7380-49d5-b8b2-331ce94f70e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.158233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aaf8c3-7380-49d5-b8b2-331ce94f70e6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.158871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaf8c3-7380-49d5-b8b2-331ce94f70e6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.161007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aaf8c3-7380-49d5-b8b2-331ce94f70e6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-50aaf8c3-7380-49d5-b8b2-331ce94f70e6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:50.173475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:50.174511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:50.175392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 370/770] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Oct 4 08:33:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:50.181032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaf8c3-7380-49d5-b8b2-331ce94f70e6 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.192215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-69704383-382f-4b34-a365-afceb40ecd36 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:50.193552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-69704383-382f-4b34-a365-afceb40ecd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:50.250732 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.278919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 401/771] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:33:50.309314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.325617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aaf8c3-7380-49d5-b8b2-331ce94f70e6 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.362929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065e789-1fe4-4daa-b342-d24befae5761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.363605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e789-1fe4-4daa-b342-d24befae5761 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.363883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e789-1fe4-4daa-b342-d24befae5761 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.364148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0065e789-1fe4-4daa-b342-d24befae5761 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.364783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065e789-1fe4-4daa-b342-d24befae5761 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:50.365083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065e789-1fe4-4daa-b342-d24befae5761 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.366433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0065e789-1fe4-4daa-b342-d24befae5761 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.371745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 371/772] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:50.377367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69704383-382f-4b34-a365-afceb40ecd36 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.485201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69704383-382f-4b34-a365-afceb40ecd36 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.520914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9624-ca86-4526-9215-59b3b8d85966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.521444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9624-ca86-4526-9215-59b3b8d85966 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.521722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9624-ca86-4526-9215-59b3b8d85966 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.522038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f9624-ca86-4526-9215-59b3b8d85966 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.522669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9624-ca86-4526-9215-59b3b8d85966 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:50.522968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9624-ca86-4526-9215-59b3b8d85966 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.524350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f9624-ca86-4526-9215-59b3b8d85966 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.529912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 402/773] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:50.535849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065e789-1fe4-4daa-b342-d24befae5761 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.618494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9624-ca86-4526-9215-59b3b8d85966 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.669682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0065e789-1fe4-4daa-b342-d24befae5761 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.710468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee5c32-d3c2-44ca-991f-16095934c0a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.711079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5c32-d3c2-44ca-991f-16095934c0a4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.711361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5c32-d3c2-44ca-991f-16095934c0a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.711662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ee5c32-d3c2-44ca-991f-16095934c0a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.718383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee5c32-d3c2-44ca-991f-16095934c0a4 None admin] RBAC: Adding query filter params (interface=public, service_id=39c8a52d56414150b539776cd2e4f249, region_id=RegionOne) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:50.718383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee5c32-d3c2-44ca-991f-16095934c0a4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.718383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ee5c32-d3c2-44ca-991f-16095934c0a4 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.722946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 372/774] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/endpoints?service_id=39c8a52d56414150b539776cd2e4f249&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:50.728687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.729957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee5c32-d3c2-44ca-991f-16095934c0a4 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.748860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:50.860397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f9624-ca86-4526-9215-59b3b8d85966 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.874843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ee5c32-d3c2-44ca-991f-16095934c0a4 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:50.919957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7a2d3-4c61-4e1f-b5cd-c2a1518dddc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.920580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7a2d3-4c61-4e1f-b5cd-c2a1518dddc4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.920857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7a2d3-4c61-4e1f-b5cd-c2a1518dddc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.921125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d7a2d3-4c61-4e1f-b5cd-c2a1518dddc4 None admin] PATH_INFO: `/v3/services/network` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.921713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7a2d3-4c61-4e1f-b5cd-c2a1518dddc4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.923062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d7a2d3-4c61-4e1f-b5cd-c2a1518dddc4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-a7d7a2d3-4c61-4e1f-b5cd-c2a1518dddc4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:50.932719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:50.933705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:50.934550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 403/775] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/services/network => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:50.944185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c726b6-b815-4696-9d0d-74d9c34665ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:50.944810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c726b6-b815-4696-9d0d-74d9c34665ae None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:50.945087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c726b6-b815-4696-9d0d-74d9c34665ae None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:50.945364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c726b6-b815-4696-9d0d-74d9c34665ae None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:50.945980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c726b6-b815-4696-9d0d-74d9c34665ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:50.947104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7a2d3-4c61-4e1f-b5cd-c2a1518dddc4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:50.947337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c726b6-b815-4696-9d0d-74d9c34665ae None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:50.959662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 373/776] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:51.090424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d7a2d3-4c61-4e1f-b5cd-c2a1518dddc4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.099039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.135600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27d9a-f163-4750-8ff5-3d8237379987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.136145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27d9a-f163-4750-8ff5-3d8237379987 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.136418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27d9a-f163-4750-8ff5-3d8237379987 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.136685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27d9a-f163-4750-8ff5-3d8237379987 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.137323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b27d9a-f163-4750-8ff5-3d8237379987 None admin] RBAC: Adding query filter params (name=network) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:51.137625 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b27d9a-f163-4750-8ff5-3d8237379987 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.138996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b27d9a-f163-4750-8ff5-3d8237379987 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.144393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 404/777] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:33:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:51.150099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c726b6-b815-4696-9d0d-74d9c34665ae None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.254682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:51.278596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c726b6-b815-4696-9d0d-74d9c34665ae None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.315461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406b64d-1d1c-4241-8a76-c769f09da705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.316100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b64d-1d1c-4241-8a76-c769f09da705 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.316381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b64d-1d1c-4241-8a76-c769f09da705 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.316657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406b64d-1d1c-4241-8a76-c769f09da705 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.317287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406b64d-1d1c-4241-8a76-c769f09da705 None admin] RBAC: Adding query filter params (type=network) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:51.317590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406b64d-1d1c-4241-8a76-c769f09da705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.318942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4406b64d-1d1c-4241-8a76-c769f09da705 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.324404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 374/778] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:51.332589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27d9a-f163-4750-8ff5-3d8237379987 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.475695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27d9a-f163-4750-8ff5-3d8237379987 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.522894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a18f64-fa0f-4a27-a167-159cee2505bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.523519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a18f64-fa0f-4a27-a167-159cee2505bd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.523805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a18f64-fa0f-4a27-a167-159cee2505bd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.524081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a18f64-fa0f-4a27-a167-159cee2505bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.524777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a18f64-fa0f-4a27-a167-159cee2505bd None admin] RBAC: Adding query filter params (interface=public, service_id=6c14abdc862d461986625ff30f908833, region_id=RegionOne) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:51.525090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a18f64-fa0f-4a27-a167-159cee2505bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.526441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a18f64-fa0f-4a27-a167-159cee2505bd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.534211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 405/779] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/endpoints?service_id=6c14abdc862d461986625ff30f908833&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:51.540262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406b64d-1d1c-4241-8a76-c769f09da705 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:51.716169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406b64d-1d1c-4241-8a76-c769f09da705 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:51.761202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac3f00-9de6-4c2a-b3a6-941e702f40c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:51.761735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3f00-9de6-4c2a-b3a6-941e702f40c0 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:51.762012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3f00-9de6-4c2a-b3a6-941e702f40c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:51.762287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac3f00-9de6-4c2a-b3a6-941e702f40c0 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:51.762892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac3f00-9de6-4c2a-b3a6-941e702f40c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:51.764266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ac3f00-9de6-4c2a-b3a6-941e702f40c0 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:51.772950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 375/780] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 08:33:51 2022] GET /identity/v3/services => generated 772 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:52.168113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0d0c4-88f1-43da-932a-83a02b8418dd None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.168458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0d0c4-88f1-43da-932a-83a02b8418dd None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.168646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0d0c4-88f1-43da-932a-83a02b8418dd None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.170201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 406/781] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:52.176921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3ef02-e8c8-4f38-a8ff-673ae5a60e49 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.177472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3ef02-e8c8-4f38-a8ff-673ae5a60e49 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.177472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf3ef02-e8c8-4f38-a8ff-673ae5a60e49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.185980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:52.200359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-cbf3ef02-e8c8-4f38-a8ff-673ae5a60e49 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:52.214629 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cbf3ef02-e8c8-4f38-a8ff-673ae5a60e49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:52.221488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e38a04-d870-481b-ac17-f39f00ffd893 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.221896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e38a04-d870-481b-ac17-f39f00ffd893 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.222067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e38a04-d870-481b-ac17-f39f00ffd893 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.223709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 407/782] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:52.229085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6522-a011-4f83-bd64-6e55a0e88779 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.229345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6522-a011-4f83-bd64-6e55a0e88779 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.229625 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a6522-a011-4f83-bd64-6e55a0e88779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.257549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-632a6522-a011-4f83-bd64-6e55a0e88779 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:52.258772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-632a6522-a011-4f83-bd64-6e55a0e88779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:52.284281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 376/783] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:33:52.310522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:52.365941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 408/784] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:33:52.406707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacdc20-6577-490a-9b70-ad38e136ec77 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.407041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacdc20-6577-490a-9b70-ad38e136ec77 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.407259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacdc20-6577-490a-9b70-ad38e136ec77 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.408962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 377/785] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:52.420759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeccaa4-95a0-46de-bea7-d0ed5618a8c3 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.420985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeccaa4-95a0-46de-bea7-d0ed5618a8c3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.421260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeccaa4-95a0-46de-bea7-d0ed5618a8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.444106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-dbeccaa4-95a0-46de-bea7-d0ed5618a8c3 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:52.445271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-dbeccaa4-95a0-46de-bea7-d0ed5618a8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:52.532167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 409/786] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:33:52.581587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacdc20-6577-490a-9b70-ad38e136ec77 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:52.689566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacdc20-6577-490a-9b70-ad38e136ec77 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.726219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0315b-7cf2-4c28-a8e7-99f1220c7aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:52.726849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0315b-7cf2-4c28-a8e7-99f1220c7aad None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.727132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0315b-7cf2-4c28-a8e7-99f1220c7aad None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.727407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0315b-7cf2-4c28-a8e7-99f1220c7aad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.729300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:52.739903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0315b-7cf2-4c28-a8e7-99f1220c7aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-14f0315b-7cf2-4c28-a8e7-99f1220c7aad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:52.744820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:52.748067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:52.750067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 378/787] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:52.755679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeccaa4-95a0-46de-bea7-d0ed5618a8c3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:52.773627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0315b-7cf2-4c28-a8e7-99f1220c7aad None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:52.880351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0315b-7cf2-4c28-a8e7-99f1220c7aad None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.948719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:52.956829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd18e5-777b-473f-bf33-af7ffe31bf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:52.957470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd18e5-777b-473f-bf33-af7ffe31bf86 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:52.957749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd18e5-777b-473f-bf33-af7ffe31bf86 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:52.958024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd18e5-777b-473f-bf33-af7ffe31bf86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:52.960265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeccaa4-95a0-46de-bea7-d0ed5618a8c3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:52.979332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd18e5-777b-473f-bf33-af7ffe31bf86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-25bd18e5-777b-473f-bf33-af7ffe31bf86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:52.984313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:52.986474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 379/788] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:52.989229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd18e5-777b-473f-bf33-af7ffe31bf86 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.008257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d104d-37ef-4b43-864b-658703d6666f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.008865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d104d-37ef-4b43-864b-658703d6666f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.009141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d104d-37ef-4b43-864b-658703d6666f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.009408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d104d-37ef-4b43-864b-658703d6666f None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.010193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d104d-37ef-4b43-864b-658703d6666f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:53.010489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d104d-37ef-4b43-864b-658703d6666f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.011879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8d104d-37ef-4b43-864b-658703d6666f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.021463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 410/789] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:53.022284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d104d-37ef-4b43-864b-658703d6666f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.050273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.098906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd18e5-777b-473f-bf33-af7ffe31bf86 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.129849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8d104d-37ef-4b43-864b-658703d6666f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.136981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941604e-4bf7-4b90-b1b3-08d76c529cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.137626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941604e-4bf7-4b90-b1b3-08d76c529cd9 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.137911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941604e-4bf7-4b90-b1b3-08d76c529cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.138208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6941604e-4bf7-4b90-b1b3-08d76c529cd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.150314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6941604e-4bf7-4b90-b1b3-08d76c529cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-6941604e-4bf7-4b90-b1b3-08d76c529cd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:53.155847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:53.156967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:53.157974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 380/790] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:53.158658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941604e-4bf7-4b90-b1b3-08d76c529cd9 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.176131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8eea71-2936-4ace-9bec-7780d2a0e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.176954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eea71-2936-4ace-9bec-7780d2a0e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.177403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eea71-2936-4ace-9bec-7780d2a0e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.177910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8eea71-2936-4ace-9bec-7780d2a0e2f3 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.178821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8eea71-2936-4ace-9bec-7780d2a0e2f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:53.179266 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8eea71-2936-4ace-9bec-7780d2a0e2f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.180788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8eea71-2936-4ace-9bec-7780d2a0e2f3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.194275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 411/791] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:53.195417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8eea71-2936-4ace-9bec-7780d2a0e2f3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.215741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.276429 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6941604e-4bf7-4b90-b1b3-08d76c529cd9 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.292934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.315423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8eea71-2936-4ace-9bec-7780d2a0e2f3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.316979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d803165-2c9d-4d44-a8c1-adcc2609643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.317819 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d803165-2c9d-4d44-a8c1-adcc2609643d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.318098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d803165-2c9d-4d44-a8c1-adcc2609643d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.318375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d803165-2c9d-4d44-a8c1-adcc2609643d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.336205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d803165-2c9d-4d44-a8c1-adcc2609643d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.337939 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d803165-2c9d-4d44-a8c1-adcc2609643d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.354685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45e95c-6048-4eb9-b310-2b38e1a2c956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.355625 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45e95c-6048-4eb9-b310-2b38e1a2c956 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.356114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45e95c-6048-4eb9-b310-2b38e1a2c956 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-9d803165-2c9d-4d44-a8c1-adcc2609643d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:53.356242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:53.357105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:53.362879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:53.362879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:53.362879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:53.362879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 381/792] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:53.362879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d803165-2c9d-4d44-a8c1-adcc2609643d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.363172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45e95c-6048-4eb9-b310-2b38e1a2c956 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.363172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45e95c-6048-4eb9-b310-2b38e1a2c956 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:53.363172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45e95c-6048-4eb9-b310-2b38e1a2c956 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.363172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45e95c-6048-4eb9-b310-2b38e1a2c956 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.374947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 412/793] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:53.376642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45e95c-6048-4eb9-b310-2b38e1a2c956 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.484211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.490532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d803165-2c9d-4d44-a8c1-adcc2609643d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.510088 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45e95c-6048-4eb9-b310-2b38e1a2c956 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.531168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bad22-7389-4951-9615-715966fb167d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.532440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bad22-7389-4951-9615-715966fb167d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.532991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bad22-7389-4951-9615-715966fb167d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.533455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bad22-7389-4951-9615-715966fb167d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.545708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bad22-7389-4951-9615-715966fb167d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.547497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267bad22-7389-4951-9615-715966fb167d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.552392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc10e9e-b02d-4e26-b81e-aeecd1cca5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.553072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc10e9e-b02d-4e26-b81e-aeecd1cca5a3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.553415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc10e9e-b02d-4e26-b81e-aeecd1cca5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.553756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc10e9e-b02d-4e26-b81e-aeecd1cca5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.554464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc10e9e-b02d-4e26-b81e-aeecd1cca5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:53.554852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc10e9e-b02d-4e26-b81e-aeecd1cca5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.556483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc10e9e-b02d-4e26-b81e-aeecd1cca5a3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-267bad22-7389-4951-9615-715966fb167d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:53.566032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:53.566985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:53.567923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:53.567923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:53.567923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:53.572559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 382/794] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:53.572559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bad22-7389-4951-9615-715966fb167d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.572764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 413/795] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:53.576509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc10e9e-b02d-4e26-b81e-aeecd1cca5a3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.596364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.678685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267bad22-7389-4951-9615-715966fb167d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.685505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc10e9e-b02d-4e26-b81e-aeecd1cca5a3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.717785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41a7135-bb29-4859-8f21-ef3686a53fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.718408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a7135-bb29-4859-8f21-ef3686a53fdb None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.718689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a7135-bb29-4859-8f21-ef3686a53fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.718964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41a7135-bb29-4859-8f21-ef3686a53fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.720260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a459ce-e7d3-4ab8-92b0-b22b76e84e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.720974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a459ce-e7d3-4ab8-92b0-b22b76e84e72 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.721254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a459ce-e7d3-4ab8-92b0-b22b76e84e72 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.721820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a459ce-e7d3-4ab8-92b0-b22b76e84e72 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.722464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a459ce-e7d3-4ab8-92b0-b22b76e84e72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:53.722768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a459ce-e7d3-4ab8-92b0-b22b76e84e72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.724149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a459ce-e7d3-4ab8-92b0-b22b76e84e72 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.728931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a7135-bb29-4859-8f21-ef3686a53fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.730352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41a7135-bb29-4859-8f21-ef3686a53fdb None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.733990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.737620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 414/796] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:53.738358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a459ce-e7d3-4ab8-92b0-b22b76e84e72 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-d41a7135-bb29-4859-8f21-ef3686a53fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:53.749815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:53.750984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:53.751961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:53.751961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:53.751961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:53.751961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 383/797] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:53.752571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d9de-7f78-4c42-bc59-a93e5f6c94ed None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.753442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d9de-7f78-4c42-bc59-a93e5f6c94ed None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.753724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0d9de-7f78-4c42-bc59-a93e5f6c94ed None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.755092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 384/798] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:53.759291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0d9de-7f78-4c42-bc59-a93e5f6c94ed None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.831380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:53.850672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a459ce-e7d3-4ab8-92b0-b22b76e84e72 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.866533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0d9de-7f78-4c42-bc59-a93e5f6c94ed None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:53.886325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695663b-56b6-4b98-bd09-f7988377579a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.886954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695663b-56b6-4b98-bd09-f7988377579a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.887236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695663b-56b6-4b98-bd09-f7988377579a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.887524 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695663b-56b6-4b98-bd09-f7988377579a None admin] PATH_INFO: `/v3/users/nova` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.895036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695663b-56b6-4b98-bd09-f7988377579a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.896510 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695663b-56b6-4b98-bd09-f7988377579a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.901563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd50d3fe-32fb-4544-a0ac-bdb424ffb51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:53.902192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d3fe-32fb-4544-a0ac-bdb424ffb51c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.902471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d3fe-32fb-4544-a0ac-bdb424ffb51c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.902744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd50d3fe-32fb-4544-a0ac-bdb424ffb51c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-e695663b-56b6-4b98-bd09-f7988377579a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:53.908363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:53.909335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:33:53.910277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:53.912225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50d3fe-32fb-4544-a0ac-bdb424ffb51c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:53.913645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd50d3fe-32fb-4544-a0ac-bdb424ffb51c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:53.914248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 415/799] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:53.915011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695663b-56b6-4b98-bd09-f7988377579a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-bd50d3fe-32fb-4544-a0ac-bdb424ffb51c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:53.926129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:53.927084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 385/800] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:53.928471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2eaee-2e38-4036-979d-ffc0c12f0f24 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:53.929104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2eaee-2e38-4036-979d-ffc0c12f0f24 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:53.929104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b2eaee-2e38-4036-979d-ffc0c12f0f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:53.948199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-e2b2eaee-2e38-4036-979d-ffc0c12f0f24 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:53.949526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e2b2eaee-2e38-4036-979d-ffc0c12f0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:53.981824 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.020324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 386/801] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:33:54.021386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2eaee-2e38-4036-979d-ffc0c12f0f24 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.046246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695663b-56b6-4b98-bd09-f7988377579a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.084953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87050bf-2ce9-4483-9aa6-43811064242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.085592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87050bf-2ce9-4483-9aa6-43811064242a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.085874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87050bf-2ce9-4483-9aa6-43811064242a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.086150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87050bf-2ce9-4483-9aa6-43811064242a None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.086798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87050bf-2ce9-4483-9aa6-43811064242a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:54.087105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87050bf-2ce9-4483-9aa6-43811064242a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.088507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87050bf-2ce9-4483-9aa6-43811064242a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.100771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 416/802] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:54.101602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87050bf-2ce9-4483-9aa6-43811064242a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.109472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.166762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b2eaee-2e38-4036-979d-ffc0c12f0f24 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.206750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4e74a-0ad2-4d26-ba54-005a6bf456ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.206940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87050bf-2ce9-4483-9aa6-43811064242a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.207357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4e74a-0ad2-4d26-ba54-005a6bf456ac None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.207667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4e74a-0ad2-4d26-ba54-005a6bf456ac None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.207941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4e74a-0ad2-4d26-ba54-005a6bf456ac None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.208774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4e74a-0ad2-4d26-ba54-005a6bf456ac None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:54.209182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4e74a-0ad2-4d26-ba54-005a6bf456ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.210580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d4e74a-0ad2-4d26-ba54-005a6bf456ac None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.228027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.231627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 387/803] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:54.232484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4e74a-0ad2-4d26-ba54-005a6bf456ac None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.245136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10696478-5266-4c63-8560-955150fae973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.245752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10696478-5266-4c63-8560-955150fae973 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.246030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10696478-5266-4c63-8560-955150fae973 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.246617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10696478-5266-4c63-8560-955150fae973 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.247200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10696478-5266-4c63-8560-955150fae973 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:54.247537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10696478-5266-4c63-8560-955150fae973 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.249130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10696478-5266-4c63-8560-955150fae973 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.267039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 417/804] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:54.268201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10696478-5266-4c63-8560-955150fae973 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.354574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d4e74a-0ad2-4d26-ba54-005a6bf456ac None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.374428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.376073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10696478-5266-4c63-8560-955150fae973 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.391729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f5e6-1b60-4d8d-86e3-321005ff198c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.403918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f5e6-1b60-4d8d-86e3-321005ff198c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.403918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f5e6-1b60-4d8d-86e3-321005ff198c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.403918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b838f5e6-1b60-4d8d-86e3-321005ff198c None admin] PATH_INFO: `/v3/users/swift` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.403918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838f5e6-1b60-4d8d-86e3-321005ff198c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.403918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b838f5e6-1b60-4d8d-86e3-321005ff198c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.411690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d4d61-9a98-452a-a89a-d69faf7cf948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.412293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d4d61-9a98-452a-a89a-d69faf7cf948 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.412573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d4d61-9a98-452a-a89a-d69faf7cf948 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.412844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d4d61-9a98-452a-a89a-d69faf7cf948 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-b838f5e6-1b60-4d8d-86e3-321005ff198c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:33:54.413526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:54.414423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 388/805] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:54.420355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f5e6-1b60-4d8d-86e3-321005ff198c None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.465988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.486916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d4d61-9a98-452a-a89a-d69faf7cf948 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.488981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d4d61-9a98-452a-a89a-d69faf7cf948 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.516213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b838f5e6-1b60-4d8d-86e3-321005ff198c None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.549611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b859b3b-3a05-416b-bdce-4a66f8bc828c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.550231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b859b3b-3a05-416b-bdce-4a66f8bc828c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.550507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b859b3b-3a05-416b-bdce-4a66f8bc828c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.550779 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b859b3b-3a05-416b-bdce-4a66f8bc828c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.561725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b859b3b-3a05-416b-bdce-4a66f8bc828c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.563136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b859b3b-3a05-416b-bdce-4a66f8bc828c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-2b859b3b-3a05-416b-bdce-4a66f8bc828c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:54.576903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:54.578077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:54.579166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:54.579166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:54.579166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:54.579166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 389/806] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:54.579166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b859b3b-3a05-416b-bdce-4a66f8bc828c None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.591048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 418/807] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:33:54.591932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d4d61-9a98-452a-a89a-d69faf7cf948 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.617548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.667435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.686356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b859b3b-3a05-416b-bdce-4a66f8bc828c None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.688840 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d4d61-9a98-452a-a89a-d69faf7cf948 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.719467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0688bc-c9c1-42da-a7a5-cf7284f7c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.720139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0688bc-c9c1-42da-a7a5-cf7284f7c857 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.720423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0688bc-c9c1-42da-a7a5-cf7284f7c857 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.720699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0688bc-c9c1-42da-a7a5-cf7284f7c857 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.721290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0688bc-c9c1-42da-a7a5-cf7284f7c857 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.723201 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0688bc-c9c1-42da-a7a5-cf7284f7c857 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.723653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31039a12-d868-44ca-aee3-29c5fe769f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.724255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31039a12-d868-44ca-aee3-29c5fe769f13 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.724536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31039a12-d868-44ca-aee3-29c5fe769f13 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.724982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31039a12-d868-44ca-aee3-29c5fe769f13 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.725988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31039a12-d868-44ca-aee3-29c5fe769f13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:54.726297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31039a12-d868-44ca-aee3-29c5fe769f13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.727882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31039a12-d868-44ca-aee3-29c5fe769f13 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-fb0688bc-c9c1-42da-a7a5-cf7284f7c857 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:54.731829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:54.732768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:54.733659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 390/808] 10.222.0.25 () {56 vars in 1129 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:54.734437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbeeee-51c6-491e-8061-225c82bcba6f None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.734437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbeeee-51c6-491e-8061-225c82bcba6f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.734629 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fbeeee-51c6-491e-8061-225c82bcba6f None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.735961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 391/809] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:54.736657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbeeee-51c6-491e-8061-225c82bcba6f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.751309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 419/810] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:54.751309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31039a12-d868-44ca-aee3-29c5fe769f13 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.834218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.841440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fbeeee-51c6-491e-8061-225c82bcba6f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.843677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31039a12-d868-44ca-aee3-29c5fe769f13 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:54.874619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df1902-ed6b-45e6-a9d3-fb4de76c9820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.875247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df1902-ed6b-45e6-a9d3-fb4de76c9820 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.875562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df1902-ed6b-45e6-a9d3-fb4de76c9820 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.875846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4df1902-ed6b-45e6-a9d3-fb4de76c9820 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.876488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df1902-ed6b-45e6-a9d3-fb4de76c9820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:54.876790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df1902-ed6b-45e6-a9d3-fb4de76c9820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.876930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cac84-121b-431b-94cf-9cfa50976634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:54.877555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cac84-121b-431b-94cf-9cfa50976634 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.877839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cac84-121b-431b-94cf-9cfa50976634 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.878115 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cac84-121b-431b-94cf-9cfa50976634 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.878203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4df1902-ed6b-45e6-a9d3-fb4de76c9820 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.880740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:54.888001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cac84-121b-431b-94cf-9cfa50976634 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:54.889420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cac84-121b-431b-94cf-9cfa50976634 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:54.889766 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 392/811] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:54.890552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df1902-ed6b-45e6-a9d3-fb4de76c9820 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-bd4cac84-121b-431b-94cf-9cfa50976634 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:54.905047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:54.906110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:54.907010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:54.907010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:54.907010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:54.907010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 420/812] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:54.907467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdb971-f66c-412d-aa2b-0a1c5260c8e6 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:54.907778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdb971-f66c-412d-aa2b-0a1c5260c8e6 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:54.908024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bdb971-f66c-412d-aa2b-0a1c5260c8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:54.926290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-40bdb971-f66c-412d-aa2b-0a1c5260c8e6 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:54.927474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-40bdb971-f66c-412d-aa2b-0a1c5260c8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:54.992931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 421/813] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:33:54.993740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdb971-f66c-412d-aa2b-0a1c5260c8e6 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:54.994648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4df1902-ed6b-45e6-a9d3-fb4de76c9820 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.030107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556080e-61a9-4683-9492-d8a2a12e911a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.030712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556080e-61a9-4683-9492-d8a2a12e911a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.030991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556080e-61a9-4683-9492-d8a2a12e911a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.031265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556080e-61a9-4683-9492-d8a2a12e911a None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.031927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556080e-61a9-4683-9492-d8a2a12e911a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:55.032231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556080e-61a9-4683-9492-d8a2a12e911a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.033610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556080e-61a9-4683-9492-d8a2a12e911a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.038235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 393/814] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:55.038841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556080e-61a9-4683-9492-d8a2a12e911a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.063023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.122436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bdb971-f66c-412d-aa2b-0a1c5260c8e6 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.144712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.156600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556080e-61a9-4683-9492-d8a2a12e911a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.161864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e26b6-5cf2-47bf-93b7-0b38dc42d8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.162497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e26b6-5cf2-47bf-93b7-0b38dc42d8ae None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.162775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e26b6-5cf2-47bf-93b7-0b38dc42d8ae None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.163044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64e26b6-5cf2-47bf-93b7-0b38dc42d8ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.172970 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e26b6-5cf2-47bf-93b7-0b38dc42d8ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.174409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64e26b6-5cf2-47bf-93b7-0b38dc42d8ae None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-d64e26b6-5cf2-47bf-93b7-0b38dc42d8ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:55.191010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:55.192023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:55.192903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:55.192903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:55.192903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:55.194431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d56d86-9e78-4800-8c7b-8cf2588cb488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.195061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d56d86-9e78-4800-8c7b-8cf2588cb488 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.195363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d56d86-9e78-4800-8c7b-8cf2588cb488 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.195641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d56d86-9e78-4800-8c7b-8cf2588cb488 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.196720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 422/815] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:55.197414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e26b6-5cf2-47bf-93b7-0b38dc42d8ae None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.202871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d56d86-9e78-4800-8c7b-8cf2588cb488 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.204331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d56d86-9e78-4800-8c7b-8cf2588cb488 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-28d56d86-9e78-4800-8c7b-8cf2588cb488 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:55.217413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:55.218295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:55.219187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:55.219187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:55.219187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:55.219187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:55.219187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:55.219187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:55.219187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:55.219187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:55.223472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 394/816] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:55.224028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d56d86-9e78-4800-8c7b-8cf2588cb488 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.298864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64e26b6-5cf2-47bf-93b7-0b38dc42d8ae None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.301883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.322755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d56d86-9e78-4800-8c7b-8cf2588cb488 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.332743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479f63b-17eb-4c83-a075-54df132655b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.333347 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479f63b-17eb-4c83-a075-54df132655b6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.333627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479f63b-17eb-4c83-a075-54df132655b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.333899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f479f63b-17eb-4c83-a075-54df132655b6 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.334547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479f63b-17eb-4c83-a075-54df132655b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:55.334847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479f63b-17eb-4c83-a075-54df132655b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.336230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f479f63b-17eb-4c83-a075-54df132655b6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.347574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 423/817] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:55.348357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479f63b-17eb-4c83-a075-54df132655b6 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.360429 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b494e-4911-4f39-b719-69d3e7027aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.361044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b494e-4911-4f39-b719-69d3e7027aa0 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.361325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b494e-4911-4f39-b719-69d3e7027aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.361774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4b494e-4911-4f39-b719-69d3e7027aa0 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.363414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b494e-4911-4f39-b719-69d3e7027aa0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:55.363754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b494e-4911-4f39-b719-69d3e7027aa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.365264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4b494e-4911-4f39-b719-69d3e7027aa0 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.369982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 395/818] 10.222.0.25 () {56 vars in 1124 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:55.370753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b494e-4911-4f39-b719-69d3e7027aa0 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.381328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.449091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f479f63b-17eb-4c83-a075-54df132655b6 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.474330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4b494e-4911-4f39-b719-69d3e7027aa0 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.481993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48c68c-1cab-4742-a8a8-fdf903bb8d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.482649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c68c-1cab-4742-a8a8-fdf903bb8d40 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.482945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c68c-1cab-4742-a8a8-fdf903bb8d40 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.483218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c48c68c-1cab-4742-a8a8-fdf903bb8d40 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.483885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48c68c-1cab-4742-a8a8-fdf903bb8d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:55.484234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48c68c-1cab-4742-a8a8-fdf903bb8d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.485594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c48c68c-1cab-4742-a8a8-fdf903bb8d40 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.496875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 424/819] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:55.497664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48c68c-1cab-4742-a8a8-fdf903bb8d40 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.507410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eae8b2-93f0-4003-b64f-79c5dee19032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.508059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae8b2-93f0-4003-b64f-79c5dee19032 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.508349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae8b2-93f0-4003-b64f-79c5dee19032 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.508601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eae8b2-93f0-4003-b64f-79c5dee19032 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.509293 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eae8b2-93f0-4003-b64f-79c5dee19032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:55.509597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eae8b2-93f0-4003-b64f-79c5dee19032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.510993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eae8b2-93f0-4003-b64f-79c5dee19032 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.522634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 396/820] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:55.523411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eae8b2-93f0-4003-b64f-79c5dee19032 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.525878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.589279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.603611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c48c68c-1cab-4742-a8a8-fdf903bb8d40 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.627341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eae8b2-93f0-4003-b64f-79c5dee19032 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.637419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ac8b-d459-4280-85f3-985eab041e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.638040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ac8b-d459-4280-85f3-985eab041e56 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.638321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ac8b-d459-4280-85f3-985eab041e56 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.638591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94ac8b-d459-4280-85f3-985eab041e56 None admin] PATH_INFO: `/v3/services/network` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.639171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ac8b-d459-4280-85f3-985eab041e56 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.640589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e94ac8b-d459-4280-85f3-985eab041e56 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-6e94ac8b-d459-4280-85f3-985eab041e56 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:55.649587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:55.650713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:55.651589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 425/821] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/services/network => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:55.652423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ac8b-d459-4280-85f3-985eab041e56 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.663727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87e27-f875-4aab-adb1-a76737ed5777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.664356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87e27-f875-4aab-adb1-a76737ed5777 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.664634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87e27-f875-4aab-adb1-a76737ed5777 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.664903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87e27-f875-4aab-adb1-a76737ed5777 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.671553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb87e27-f875-4aab-adb1-a76737ed5777 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.672986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb87e27-f875-4aab-adb1-a76737ed5777 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-4bb87e27-f875-4aab-adb1-a76737ed5777 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:55.684226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:55.685260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:55.686343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:55.686343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:55.686343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:55.686343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:55.686343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:55.686343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:55.686343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:55.686343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:55.686343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 397/822] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:55.686922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87e27-f875-4aab-adb1-a76737ed5777 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.745926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.753956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94ac8b-d459-4280-85f3-985eab041e56 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.784984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb87e27-f875-4aab-adb1-a76737ed5777 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.786780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a1ae-0dec-404f-8152-17af73a0b3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.787389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a1ae-0dec-404f-8152-17af73a0b3d0 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.787702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a1ae-0dec-404f-8152-17af73a0b3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.787977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b76a1ae-0dec-404f-8152-17af73a0b3d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.788642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76a1ae-0dec-404f-8152-17af73a0b3d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.790001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b76a1ae-0dec-404f-8152-17af73a0b3d0 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.818268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29e8d-3f58-4df4-801e-2c36e9685ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.818885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29e8d-3f58-4df4-801e-2c36e9685ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.819165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29e8d-3f58-4df4-801e-2c36e9685ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.819439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc29e8d-3f58-4df4-801e-2c36e9685ba1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:55.825950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc29e8d-3f58-4df4-801e-2c36e9685ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:55.827370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc29e8d-3f58-4df4-801e-2c36e9685ba1 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-efc29e8d-3f58-4df4-801e-2c36e9685ba1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:33:55.839146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:55.840195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 398/823] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:55.841177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29e8d-3f58-4df4-801e-2c36e9685ba1 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.917915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 426/824] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:33:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:55.918780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a1ae-0dec-404f-8152-17af73a0b3d0 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:55.932777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.942593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc29e8d-3f58-4df4-801e-2c36e9685ba1 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:55.970849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:55.991710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f22a-2e4e-46db-acc7-94562053032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:55.992389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f22a-2e4e-46db-acc7-94562053032a None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:55.992680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f22a-2e4e-46db-acc7-94562053032a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:55.993185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99f22a-2e4e-46db-acc7-94562053032a None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/c429ad73f92e4f6d995198189b64406b/roles/65669c196efb4b919bf9ee6dd9b1f623` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.012077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f22a-2e4e-46db-acc7-94562053032a None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=c429ad73f92e4f6d995198189b64406b, role_id=65669c196efb4b919bf9ee6dd9b1f623)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.013553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99f22a-2e4e-46db-acc7-94562053032a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.031328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b76a1ae-0dec-404f-8152-17af73a0b3d0 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.067816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479513e-5405-4852-83e7-9a0787403ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.068435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479513e-5405-4852-83e7-9a0787403ee2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.068710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479513e-5405-4852-83e7-9a0787403ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.068977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479513e-5405-4852-83e7-9a0787403ee2 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.069615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479513e-5405-4852-83e7-9a0787403ee2 None admin] RBAC: Adding query filter params (name=network) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:56.070033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479513e-5405-4852-83e7-9a0787403ee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.071415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a479513e-5405-4852-83e7-9a0787403ee2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.076449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 427/825] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:33:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:56.077279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479513e-5405-4852-83e7-9a0787403ee2 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.124490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 399/826] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:55 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/c429ad73f92e4f6d995198189b64406b/roles/65669c196efb4b919bf9ee6dd9b1f623 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:56.127669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f22a-2e4e-46db-acc7-94562053032a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.167927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:56.200997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479513e-5405-4852-83e7-9a0787403ee2 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.249444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf85cfd-2856-43ba-9f03-11219ddad593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.250074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85cfd-2856-43ba-9f03-11219ddad593 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.250351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85cfd-2856-43ba-9f03-11219ddad593 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.250622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf85cfd-2856-43ba-9f03-11219ddad593 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.251663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf85cfd-2856-43ba-9f03-11219ddad593 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:56.251974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf85cfd-2856-43ba-9f03-11219ddad593 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.254324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf85cfd-2856-43ba-9f03-11219ddad593 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.258547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99f22a-2e4e-46db-acc7-94562053032a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.271403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 428/827] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:56.272757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf85cfd-2856-43ba-9f03-11219ddad593 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.301803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74e4ba-d1cf-42de-b459-fa29ffd7daca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.302865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74e4ba-d1cf-42de-b459-fa29ffd7daca None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.303340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74e4ba-d1cf-42de-b459-fa29ffd7daca None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.303874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74e4ba-d1cf-42de-b459-fa29ffd7daca None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.305511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74e4ba-d1cf-42de-b459-fa29ffd7daca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:56.306177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74e4ba-d1cf-42de-b459-fa29ffd7daca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.307850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74e4ba-d1cf-42de-b459-fa29ffd7daca None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.325246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 400/828] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:33:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:56.326225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74e4ba-d1cf-42de-b459-fa29ffd7daca None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.359354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:56.388264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf85cfd-2856-43ba-9f03-11219ddad593 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.430373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc38dc-75d6-4742-aa49-a1137cb9d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.431119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc38dc-75d6-4742-aa49-a1137cb9d54f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.431539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc38dc-75d6-4742-aa49-a1137cb9d54f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.431815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc38dc-75d6-4742-aa49-a1137cb9d54f None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.432603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc38dc-75d6-4742-aa49-a1137cb9d54f None admin] RBAC: Adding query filter params (type=network) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:56.432913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc38dc-75d6-4742-aa49-a1137cb9d54f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.434903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc38dc-75d6-4742-aa49-a1137cb9d54f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.436712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:56.442509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 429/829] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:33:56 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:56.443651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc38dc-75d6-4742-aa49-a1137cb9d54f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.446812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74e4ba-d1cf-42de-b459-fa29ffd7daca None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.489970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5762e9-f080-4054-9dfa-c3d7e01b0da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.490852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5762e9-f080-4054-9dfa-c3d7e01b0da1 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.491297 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5762e9-f080-4054-9dfa-c3d7e01b0da1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.491778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5762e9-f080-4054-9dfa-c3d7e01b0da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.492740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5762e9-f080-4054-9dfa-c3d7e01b0da1 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=e05901861bc34c2398ec600150296657) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:56.493194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5762e9-f080-4054-9dfa-c3d7e01b0da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.494800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5762e9-f080-4054-9dfa-c3d7e01b0da1 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.502304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 401/830] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:33:56 2022] GET /identity/v3/role_assignments?user.id=e05901861bc34c2398ec600150296657&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:56.503927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5762e9-f080-4054-9dfa-c3d7e01b0da1 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:56.605064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc38dc-75d6-4742-aa49-a1137cb9d54f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.681660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f68e5-aefe-499a-a65e-bbee65af5eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.682860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f68e5-aefe-499a-a65e-bbee65af5eaf None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.684486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f68e5-aefe-499a-a65e-bbee65af5eaf None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.685102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f68e5-aefe-499a-a65e-bbee65af5eaf None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/590ac0c1da06460a8d32852f9c2e3609/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.688981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f68e5-aefe-499a-a65e-bbee65af5eaf None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=590ac0c1da06460a8d32852f9c2e3609, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.690255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:56.692825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f68e5-aefe-499a-a65e-bbee65af5eaf None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.708646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5762e9-f080-4054-9dfa-c3d7e01b0da1 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:56.749868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554e8c6e-6138-4871-82ba-54953e6a7d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:56.750539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e8c6e-6138-4871-82ba-54953e6a7d53 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:56.750822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e8c6e-6138-4871-82ba-54953e6a7d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:56.751092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554e8c6e-6138-4871-82ba-54953e6a7d53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:56.751842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e8c6e-6138-4871-82ba-54953e6a7d53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:56.753234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554e8c6e-6138-4871-82ba-54953e6a7d53 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:56.766261 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 430/831] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:33:56 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/590ac0c1da06460a8d32852f9c2e3609/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:33:56.861340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 402/832] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:33:56 2022] POST /identity/v3/endpoints => generated 337 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:33:58.211930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99a21a-df67-4ed7-aa17-44fc62ef694f None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.212944 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99a21a-df67-4ed7-aa17-44fc62ef694f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.213427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc99a21a-df67-4ed7-aa17-44fc62ef694f None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.215457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 431/833] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:58.220804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dea37-c09f-4bd5-96e6-04bffba92660 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.221725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dea37-c09f-4bd5-96e6-04bffba92660 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.222223 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374dea37-c09f-4bd5-96e6-04bffba92660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.240683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-374dea37-c09f-4bd5-96e6-04bffba92660 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:58.242153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-374dea37-c09f-4bd5-96e6-04bffba92660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:58.323612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 403/834] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:33:58.466966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf18d5b-be80-4553-8147-249c7f4861cd None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.467264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf18d5b-be80-4553-8147-249c7f4861cd None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.467429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf18d5b-be80-4553-8147-249c7f4861cd None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.469050 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 432/835] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:58.474827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8663-e95b-46e9-9834-d084cf97cb74 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.475115 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8663-e95b-46e9-9834-d084cf97cb74 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.475390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7a8663-e95b-46e9-9834-d084cf97cb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.498445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1c7a8663-e95b-46e9-9834-d084cf97cb74 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:58.499982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1c7a8663-e95b-46e9-9834-d084cf97cb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:58.568933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 404/836] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:33:58.597969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf18d5b-be80-4553-8147-249c7f4861cd None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:58.701867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:58.785092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf18d5b-be80-4553-8147-249c7f4861cd None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:58.843586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bda98-33e4-4e99-bb40-be330a238875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:58.845108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bda98-33e4-4e99-bb40-be330a238875 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.845935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bda98-33e4-4e99-bb40-be330a238875 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.847184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16bda98-33e4-4e99-bb40-be330a238875 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.848491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bda98-33e4-4e99-bb40-be330a238875 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:58.851292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16bda98-33e4-4e99-bb40-be330a238875 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:58.854338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93a9f-bd24-4409-8311-60e86574541b None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.854624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93a9f-bd24-4409-8311-60e86574541b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.854913 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec93a9f-bd24-4409-8311-60e86574541b None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.856514 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 405/837] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:33:58.861356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe757a1-f61b-45ee-91a2-9b73f90f8bb2 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:58.861632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe757a1-f61b-45ee-91a2-9b73f90f8bb2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:58.862025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe757a1-f61b-45ee-91a2-9b73f90f8bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-d16bda98-33e4-4e99-bb40-be330a238875 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:58.873079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:58.874693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:33:58.876324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:58.880019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:58.880099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 433/838] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:58.885901 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bda98-33e4-4e99-bb40-be330a238875 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:58.886932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9fe757a1-f61b-45ee-91a2-9b73f90f8bb2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:58.888355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9fe757a1-f61b-45ee-91a2-9b73f90f8bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:58.967863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 406/839] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:33:59.013917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe757a1-f61b-45ee-91a2-9b73f90f8bb2 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.024060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16bda98-33e4-4e99-bb40-be330a238875 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.054600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.070274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20565f9-e62b-42f6-b0c7-e3a1a544ab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.070991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20565f9-e62b-42f6-b0c7-e3a1a544ab71 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.075464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20565f9-e62b-42f6-b0c7-e3a1a544ab71 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.075464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20565f9-e62b-42f6-b0c7-e3a1a544ab71 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.075464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20565f9-e62b-42f6-b0c7-e3a1a544ab71 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:59.075464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20565f9-e62b-42f6-b0c7-e3a1a544ab71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.075464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20565f9-e62b-42f6-b0c7-e3a1a544ab71 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.084500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 434/840] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:59.086068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20565f9-e62b-42f6-b0c7-e3a1a544ab71 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.126192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe757a1-f61b-45ee-91a2-9b73f90f8bb2 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.167920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bac2b8-722a-4e98-8906-79b75cdb7f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.168561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bac2b8-722a-4e98-8906-79b75cdb7f5d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.168839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bac2b8-722a-4e98-8906-79b75cdb7f5d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.169109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bac2b8-722a-4e98-8906-79b75cdb7f5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.172160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.181493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bac2b8-722a-4e98-8906-79b75cdb7f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-f2bac2b8-722a-4e98-8906-79b75cdb7f5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:59.188301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:59.189208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:59.190069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 407/841] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:33:59.190831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29f40b-4638-4ecf-9a2a-c077e48d7a32 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.191377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29f40b-4638-4ecf-9a2a-c077e48d7a32 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.191377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b29f40b-4638-4ecf-9a2a-c077e48d7a32 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.192659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 408/842] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:33:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:33:59.196860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29f40b-4638-4ecf-9a2a-c077e48d7a32 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.198652 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20565f9-e62b-42f6-b0c7-e3a1a544ab71 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.234053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2450c5-3e76-4b03-9622-8fe59bb70efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.235369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2450c5-3e76-4b03-9622-8fe59bb70efd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.235749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2450c5-3e76-4b03-9622-8fe59bb70efd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.236026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2450c5-3e76-4b03-9622-8fe59bb70efd None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.236792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2450c5-3e76-4b03-9622-8fe59bb70efd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:59.237102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2450c5-3e76-4b03-9622-8fe59bb70efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.238593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2450c5-3e76-4b03-9622-8fe59bb70efd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.251649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 435/843] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:33:59.251649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50213bf8-1565-4ac5-84d0-959e2b06fa6e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.251649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50213bf8-1565-4ac5-84d0-959e2b06fa6e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.251649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50213bf8-1565-4ac5-84d0-959e2b06fa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.270427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-50213bf8-1565-4ac5-84d0-959e2b06fa6e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:33:59.271699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-50213bf8-1565-4ac5-84d0-959e2b06fa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:33:59.322600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.323378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b29f40b-4638-4ecf-9a2a-c077e48d7a32 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.345371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 436/844] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:33:59 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:33:59.347018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50213bf8-1565-4ac5-84d0-959e2b06fa6e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.372034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa263587-872f-43ee-9fea-2f67867c89a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.372783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa263587-872f-43ee-9fea-2f67867c89a0 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.373137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa263587-872f-43ee-9fea-2f67867c89a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.373492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa263587-872f-43ee-9fea-2f67867c89a0 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.374671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa263587-872f-43ee-9fea-2f67867c89a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:59.375053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa263587-872f-43ee-9fea-2f67867c89a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.377608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa263587-872f-43ee-9fea-2f67867c89a0 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.391093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 409/845] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:59.397917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa263587-872f-43ee-9fea-2f67867c89a0 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.471405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50213bf8-1565-4ac5-84d0-959e2b06fa6e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.476875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.517954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc3a20-5e5a-4aa4-ae99-ae284040a9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.519199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc3a20-5e5a-4aa4-ae99-ae284040a9c9 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.519548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc3a20-5e5a-4aa4-ae99-ae284040a9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.519829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbc3a20-5e5a-4aa4-ae99-ae284040a9c9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.520703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc3a20-5e5a-4aa4-ae99-ae284040a9c9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.522735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbc3a20-5e5a-4aa4-ae99-ae284040a9c9 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.527720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa263587-872f-43ee-9fea-2f67867c89a0 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-9dbc3a20-5e5a-4aa4-ae99-ae284040a9c9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:59.533705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:59.534676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:59.536276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 437/846] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:59.541209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc3a20-5e5a-4aa4-ae99-ae284040a9c9 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.570119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa551a-a8e8-4731-8f01-ba40877180a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.571610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa551a-a8e8-4731-8f01-ba40877180a0 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.572103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa551a-a8e8-4731-8f01-ba40877180a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.572653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa551a-a8e8-4731-8f01-ba40877180a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.588094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa551a-a8e8-4731-8f01-ba40877180a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.588797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.590575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa551a-a8e8-4731-8f01-ba40877180a0 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-87aa551a-a8e8-4731-8f01-ba40877180a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:33:59.607300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:59.608316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:33:59.609254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:33:59.609254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:33:59.609254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:33:59.616075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 410/847] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:59.617722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa551a-a8e8-4731-8f01-ba40877180a0 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.644470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbc3a20-5e5a-4aa4-ae99-ae284040a9c9 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.679675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d047b-43e4-407b-b2d2-88e89ca42a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.680389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d047b-43e4-407b-b2d2-88e89ca42a97 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.680788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d047b-43e4-407b-b2d2-88e89ca42a97 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.681077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d047b-43e4-407b-b2d2-88e89ca42a97 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.681700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d047b-43e4-407b-b2d2-88e89ca42a97 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:59.682001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d047b-43e4-407b-b2d2-88e89ca42a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.683348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d047b-43e4-407b-b2d2-88e89ca42a97 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.693191 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 438/848] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:59.694050 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d047b-43e4-407b-b2d2-88e89ca42a97 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.725296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa551a-a8e8-4731-8f01-ba40877180a0 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.734279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.763128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11532fa9-b5f6-4cab-be4c-e347348a6498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.763825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11532fa9-b5f6-4cab-be4c-e347348a6498 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.764210 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11532fa9-b5f6-4cab-be4c-e347348a6498 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.764489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11532fa9-b5f6-4cab-be4c-e347348a6498 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.765150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11532fa9-b5f6-4cab-be4c-e347348a6498 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:59.765836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11532fa9-b5f6-4cab-be4c-e347348a6498 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.767650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11532fa9-b5f6-4cab-be4c-e347348a6498 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.787990 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 411/849] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:59.789102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11532fa9-b5f6-4cab-be4c-e347348a6498 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.801698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d047b-43e4-407b-b2d2-88e89ca42a97 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.811415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:33:59.836029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefa508-732c-4214-8056-1fffb5ffd4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.836587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefa508-732c-4214-8056-1fffb5ffd4a1 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.836869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefa508-732c-4214-8056-1fffb5ffd4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.837141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfefa508-732c-4214-8056-1fffb5ffd4a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.848664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfefa508-732c-4214-8056-1fffb5ffd4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-bfefa508-732c-4214-8056-1fffb5ffd4a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:33:59.853867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:33:59.854975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:33:59.856192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 439/850] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:33:59.860593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefa508-732c-4214-8056-1fffb5ffd4a1 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.904348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11532fa9-b5f6-4cab-be4c-e347348a6498 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.942102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532cd8-225e-4a2e-9c23-0afad8fa11fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:33:59.942707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532cd8-225e-4a2e-9c23-0afad8fa11fa None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:33:59.942986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532cd8-225e-4a2e-9c23-0afad8fa11fa None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:33:59.943250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce532cd8-225e-4a2e-9c23-0afad8fa11fa None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:33:59.943915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce532cd8-225e-4a2e-9c23-0afad8fa11fa None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:33:59.944235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce532cd8-225e-4a2e-9c23-0afad8fa11fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:33:59.945566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce532cd8-225e-4a2e-9c23-0afad8fa11fa None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:33:59.950058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 412/851] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:33:59.950832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532cd8-225e-4a2e-9c23-0afad8fa11fa None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:33:59.973529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfefa508-732c-4214-8056-1fffb5ffd4a1 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:33:59.991981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.016460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57e23-55de-4907-96a1-07bb9e21832e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.017121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57e23-55de-4907-96a1-07bb9e21832e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.017409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57e23-55de-4907-96a1-07bb9e21832e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.017677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f57e23-55de-4907-96a1-07bb9e21832e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.026758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f57e23-55de-4907-96a1-07bb9e21832e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.028213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f57e23-55de-4907-96a1-07bb9e21832e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-86f57e23-55de-4907-96a1-07bb9e21832e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:00.042546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:00.043618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:00.044669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:00.049185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 440/852] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:00.050513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57e23-55de-4907-96a1-07bb9e21832e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.083671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.090282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce532cd8-225e-4a2e-9c23-0afad8fa11fa None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.132994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbba95-a4af-4e5c-8106-a757028ada97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.134857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbba95-a4af-4e5c-8106-a757028ada97 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.135292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbba95-a4af-4e5c-8106-a757028ada97 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.135735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbba95-a4af-4e5c-8106-a757028ada97 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.136556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbba95-a4af-4e5c-8106-a757028ada97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:00.137008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbba95-a4af-4e5c-8106-a757028ada97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.139069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbba95-a4af-4e5c-8106-a757028ada97 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.148874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 413/853] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:33:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:00.154911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbba95-a4af-4e5c-8106-a757028ada97 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.185119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f57e23-55de-4907-96a1-07bb9e21832e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.228481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e42491-6ac1-4a5e-86be-a671d51dd84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.229424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e42491-6ac1-4a5e-86be-a671d51dd84d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.229951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e42491-6ac1-4a5e-86be-a671d51dd84d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.230426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e42491-6ac1-4a5e-86be-a671d51dd84d None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.231411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e42491-6ac1-4a5e-86be-a671d51dd84d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:00.231883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e42491-6ac1-4a5e-86be-a671d51dd84d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.233535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e42491-6ac1-4a5e-86be-a671d51dd84d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.253493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 441/854] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:00.259730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e42491-6ac1-4a5e-86be-a671d51dd84d None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.265029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.271418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbba95-a4af-4e5c-8106-a757028ada97 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.307265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98154b11-79a9-4edd-98b4-eef0fe68ef95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.308078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98154b11-79a9-4edd-98b4-eef0fe68ef95 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.308719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98154b11-79a9-4edd-98b4-eef0fe68ef95 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.309466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98154b11-79a9-4edd-98b4-eef0fe68ef95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.322392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98154b11-79a9-4edd-98b4-eef0fe68ef95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.324263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98154b11-79a9-4edd-98b4-eef0fe68ef95 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-98154b11-79a9-4edd-98b4-eef0fe68ef95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:00.342103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:00.343249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:00.344401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:00.344401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:00.344401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:00.350025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 414/855] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:00.351154 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98154b11-79a9-4edd-98b4-eef0fe68ef95 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.359995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.376967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e42491-6ac1-4a5e-86be-a671d51dd84d None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.415908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00df378-ca77-45cc-8721-764f4644b665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.416763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00df378-ca77-45cc-8721-764f4644b665 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.417219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00df378-ca77-45cc-8721-764f4644b665 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.417666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00df378-ca77-45cc-8721-764f4644b665 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.460272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98154b11-79a9-4edd-98b4-eef0fe68ef95 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.494025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00df378-ca77-45cc-8721-764f4644b665 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.496279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00df378-ca77-45cc-8721-764f4644b665 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.497435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a458e1-5562-4715-ae5b-c119608d9088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.498052 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a458e1-5562-4715-ae5b-c119608d9088 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.498330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a458e1-5562-4715-ae5b-c119608d9088 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.498603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a458e1-5562-4715-ae5b-c119608d9088 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.499484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a458e1-5562-4715-ae5b-c119608d9088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:00.499770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a458e1-5562-4715-ae5b-c119608d9088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.502135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a458e1-5562-4715-ae5b-c119608d9088 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.521880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 415/856] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:00.523250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a458e1-5562-4715-ae5b-c119608d9088 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.532913 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.611929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.629585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 442/857] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:00.634822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00df378-ca77-45cc-8721-764f4644b665 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.670088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a458e1-5562-4715-ae5b-c119608d9088 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.720773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb2acd-09a6-4c48-9b9f-c92341c79baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.722666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb2acd-09a6-4c48-9b9f-c92341c79baa None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.723248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb2acd-09a6-4c48-9b9f-c92341c79baa None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.723988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb2acd-09a6-4c48-9b9f-c92341c79baa None admin] PATH_INFO: `/v3/users/swift` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.734798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb2acd-09a6-4c48-9b9f-c92341c79baa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.737876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fb2acd-09a6-4c48-9b9f-c92341c79baa None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.744691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00df378-ca77-45cc-8721-764f4644b665 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-b1fb2acd-09a6-4c48-9b9f-c92341c79baa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:00.752227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:00.753722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 04 08:34:00.757965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:00.759573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 416/858] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:00.760872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb2acd-09a6-4c48-9b9f-c92341c79baa None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.798684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebdffa-6923-4284-a766-e3aa78788040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.800201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebdffa-6923-4284-a766-e3aa78788040 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.800662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebdffa-6923-4284-a766-e3aa78788040 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.801377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebdffa-6923-4284-a766-e3aa78788040 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.814238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebdffa-6923-4284-a766-e3aa78788040 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.816770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebdffa-6923-4284-a766-e3aa78788040 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.832442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-c6ebdffa-6923-4284-a766-e3aa78788040 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:00.836107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:00.837027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:00.837924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:00.837924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:00.837924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:00.846380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 443/859] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:00.846562 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebdffa-6923-4284-a766-e3aa78788040 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.880314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb2acd-09a6-4c48-9b9f-c92341c79baa None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:00.906054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:00.926617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f448129-69f2-47aa-95a5-32d42ace049a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:00.928101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f448129-69f2-47aa-95a5-32d42ace049a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:00.928927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f448129-69f2-47aa-95a5-32d42ace049a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:00.929418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f448129-69f2-47aa-95a5-32d42ace049a None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:00.930570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f448129-69f2-47aa-95a5-32d42ace049a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:00.931310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f448129-69f2-47aa-95a5-32d42ace049a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:00.933175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f448129-69f2-47aa-95a5-32d42ace049a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:00.958123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 417/860] 10.222.0.25 () {56 vars in 1135 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:00.964675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f448129-69f2-47aa-95a5-32d42ace049a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:00.975623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebdffa-6923-4284-a766-e3aa78788040 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.022071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a6c11-169a-4214-b2f7-f8ec62bb8d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.023090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6c11-169a-4214-b2f7-f8ec62bb8d90 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.023638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6c11-169a-4214-b2f7-f8ec62bb8d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.024139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a6c11-169a-4214-b2f7-f8ec62bb8d90 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.024980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a6c11-169a-4214-b2f7-f8ec62bb8d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:01.025483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a6c11-169a-4214-b2f7-f8ec62bb8d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.027104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a6c11-169a-4214-b2f7-f8ec62bb8d90 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.047838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 444/861] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:01.049980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a6c11-169a-4214-b2f7-f8ec62bb8d90 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.113869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f448129-69f2-47aa-95a5-32d42ace049a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.146451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.151560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.155209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a6c11-169a-4214-b2f7-f8ec62bb8d90 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.164937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aafb41-78ae-4883-bd61-7d6d5a591921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.169147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aafb41-78ae-4883-bd61-7d6d5a591921 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.169147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aafb41-78ae-4883-bd61-7d6d5a591921 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.169147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aafb41-78ae-4883-bd61-7d6d5a591921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.197934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64567-3f9b-459a-b814-693e660c9bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.199978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64567-3f9b-459a-b814-693e660c9bf5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.199978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64567-3f9b-459a-b814-693e660c9bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.200171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c64567-3f9b-459a-b814-693e660c9bf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.208991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c64567-3f9b-459a-b814-693e660c9bf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.211322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c64567-3f9b-459a-b814-693e660c9bf5 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-01c64567-3f9b-459a-b814-693e660c9bf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:01.225966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:01.227068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:01.228229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:01.228229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:01.228229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:01.228229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:01.228229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:01.228229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:01.228229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:01.228229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:01.235305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 445/862] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:01.236548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64567-3f9b-459a-b814-693e660c9bf5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.256140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aafb41-78ae-4883-bd61-7d6d5a591921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.258632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aafb41-78ae-4883-bd61-7d6d5a591921 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.350255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c64567-3f9b-459a-b814-693e660c9bf5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.387753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 418/863] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:00 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:01.393546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aafb41-78ae-4883-bd61-7d6d5a591921 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.399874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54f81a-9578-4b6b-8f36-67c942c6a041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.400738 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54f81a-9578-4b6b-8f36-67c942c6a041 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.401226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54f81a-9578-4b6b-8f36-67c942c6a041 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.401708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54f81a-9578-4b6b-8f36-67c942c6a041 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.403129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54f81a-9578-4b6b-8f36-67c942c6a041 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:01.403677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54f81a-9578-4b6b-8f36-67c942c6a041 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.406200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54f81a-9578-4b6b-8f36-67c942c6a041 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.421630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.424643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 446/864] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:01.430984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54f81a-9578-4b6b-8f36-67c942c6a041 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.454801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.507304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aafb41-78ae-4883-bd61-7d6d5a591921 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.542082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54f81a-9578-4b6b-8f36-67c942c6a041 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.543178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c953fa68-4ca6-4fcc-ba58-dc8bb5a29ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.543839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953fa68-4ca6-4fcc-ba58-dc8bb5a29ed1 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.544118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953fa68-4ca6-4fcc-ba58-dc8bb5a29ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.545106 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c953fa68-4ca6-4fcc-ba58-dc8bb5a29ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.555382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953fa68-4ca6-4fcc-ba58-dc8bb5a29ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.556957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c953fa68-4ca6-4fcc-ba58-dc8bb5a29ed1 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-c953fa68-4ca6-4fcc-ba58-dc8bb5a29ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:01.573875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:01.574853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:01.575798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:01.575798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:01.575798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:01.575798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 419/865] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:01.575798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b84000-95e1-4d2b-9581-7f7f88fdc5f6 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.575798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b84000-95e1-4d2b-9581-7f7f88fdc5f6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.575798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b84000-95e1-4d2b-9581-7f7f88fdc5f6 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.576436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 420/866] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:01.581760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b84000-95e1-4d2b-9581-7f7f88fdc5f6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.587284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476bbfe-3551-4362-ab9c-6ff6096726e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.590908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476bbfe-3551-4362-ab9c-6ff6096726e8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.590908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476bbfe-3551-4362-ab9c-6ff6096726e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.590908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476bbfe-3551-4362-ab9c-6ff6096726e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.590908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476bbfe-3551-4362-ab9c-6ff6096726e8 None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=c429ad73f92e4f6d995198189b64406b) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:01.590908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476bbfe-3551-4362-ab9c-6ff6096726e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.590908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476bbfe-3551-4362-ab9c-6ff6096726e8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.607544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 447/867] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/role_assignments?user.id=c429ad73f92e4f6d995198189b64406b&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:01.607544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9df80-277f-4989-805e-0df6be88791a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.607544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9df80-277f-4989-805e-0df6be88791a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.607544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e9df80-277f-4989-805e-0df6be88791a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.619270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-84e9df80-277f-4989-805e-0df6be88791a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:01.620673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-84e9df80-277f-4989-805e-0df6be88791a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:01.693021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.715420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 448/868] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:01.737027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b84000-95e1-4d2b-9581-7f7f88fdc5f6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.776977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9797-5529-4103-a14f-3fc59e288b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.777648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9797-5529-4103-a14f-3fc59e288b05 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.777930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9797-5529-4103-a14f-3fc59e288b05 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.778196 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ca9797-5529-4103-a14f-3fc59e288b05 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.778849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca9797-5529-4103-a14f-3fc59e288b05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:01.779149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca9797-5529-4103-a14f-3fc59e288b05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.780576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ca9797-5529-4103-a14f-3fc59e288b05 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.793754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 421/869] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:01.799212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9df80-277f-4989-805e-0df6be88791a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:01.815385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:01.905232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e9df80-277f-4989-805e-0df6be88791a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:01.939716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542ab97-9947-4937-a4d4-b952561603ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:01.940879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542ab97-9947-4937-a4d4-b952561603ed None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:01.941155 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542ab97-9947-4937-a4d4-b952561603ed None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:01.941420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9542ab97-9947-4937-a4d4-b952561603ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:01.948238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542ab97-9947-4937-a4d4-b952561603ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:01.949665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9542ab97-9947-4937-a4d4-b952561603ed None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-9542ab97-9947-4937-a4d4-b952561603ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:01.961353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:01.962263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:01.963170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:01.963170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:01.963170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:01.963170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:01.963170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:01.963170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:01.963170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:01.963170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:01.963170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 449/870] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:01.968425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9797-5529-4103-a14f-3fc59e288b05 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.005231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542ab97-9947-4937-a4d4-b952561603ed None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.086916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ca9797-5529-4103-a14f-3fc59e288b05 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.103363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:02.128628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c306b1-e60a-46bf-aed9-0695e83677f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.129553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c306b1-e60a-46bf-aed9-0695e83677f0 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.129838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c306b1-e60a-46bf-aed9-0695e83677f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.130117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c306b1-e60a-46bf-aed9-0695e83677f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.131693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c306b1-e60a-46bf-aed9-0695e83677f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:02.132007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c306b1-e60a-46bf-aed9-0695e83677f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.133230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9542ab97-9947-4937-a4d4-b952561603ed None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.133747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c306b1-e60a-46bf-aed9-0695e83677f0 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.136587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:02.147679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 422/871] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:02.152475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c306b1-e60a-46bf-aed9-0695e83677f0 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.178523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae0e67-976a-4428-aa38-8b7cac3ddfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.179131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0e67-976a-4428-aa38-8b7cac3ddfcd None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.179414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0e67-976a-4428-aa38-8b7cac3ddfcd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.179831 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae0e67-976a-4428-aa38-8b7cac3ddfcd None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.180480 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0e67-976a-4428-aa38-8b7cac3ddfcd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.181841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae0e67-976a-4428-aa38-8b7cac3ddfcd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.253515 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 450/872] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:02 2022] POST /identity/v3/services => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:02.254797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334272-6101-4940-8bb1-954aff0fbc1e None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.255091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334272-6101-4940-8bb1-954aff0fbc1e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.255362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0334272-6101-4940-8bb1-954aff0fbc1e None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.256764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 451/873] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:02.264470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c306b1-e60a-46bf-aed9-0695e83677f0 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.265623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e38e0-3fcd-4d5b-a2bd-0c881d866cdc None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.266026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e38e0-3fcd-4d5b-a2bd-0c881d866cdc None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.266399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e38e0-3fcd-4d5b-a2bd-0c881d866cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.287653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-fd6e38e0-3fcd-4d5b-a2bd-0c881d866cdc None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:02.289025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fd6e38e0-3fcd-4d5b-a2bd-0c881d866cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:02.317604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5da54-139d-48ab-b806-d4ed7b920398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.318390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5da54-139d-48ab-b806-d4ed7b920398 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.318766 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5da54-139d-48ab-b806-d4ed7b920398 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.319132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc5da54-139d-48ab-b806-d4ed7b920398 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.320267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5da54-139d-48ab-b806-d4ed7b920398 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=590ac0c1da06460a8d32852f9c2e3609) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:02.320689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5da54-139d-48ab-b806-d4ed7b920398 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.322434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc5da54-139d-48ab-b806-d4ed7b920398 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.335754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 423/874] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:02 2022] GET /identity/v3/role_assignments?user.id=590ac0c1da06460a8d32852f9c2e3609&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:02.378888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 452/875] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:02.648964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5da54-139d-48ab-b806-d4ed7b920398 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:02.707035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:02.751747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc5da54-139d-48ab-b806-d4ed7b920398 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:02.787125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc32e640-b28a-4f3d-a6a7-88f933358331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:02.787848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e640-b28a-4f3d-a6a7-88f933358331 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:02.788178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e640-b28a-4f3d-a6a7-88f933358331 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:02.788486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32e640-b28a-4f3d-a6a7-88f933358331 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:02.789146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32e640-b28a-4f3d-a6a7-88f933358331 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:02.790482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc32e640-b28a-4f3d-a6a7-88f933358331 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:02.893506 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 424/876] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:02 2022] POST /identity/v3/services => generated 269 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:03.923203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5451b-83cf-46ca-8a65-4f55b729be48 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.923768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5451b-83cf-46ca-8a65-4f55b729be48 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.923768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5451b-83cf-46ca-8a65-4f55b729be48 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.925813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 453/877] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:03.931284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099048c-b4aa-4c9d-862d-f1ac1f42e93c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:03.931707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099048c-b4aa-4c9d-862d-f1ac1f42e93c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:03.931880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b099048c-b4aa-4c9d-862d-f1ac1f42e93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:03.950248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b099048c-b4aa-4c9d-862d-f1ac1f42e93c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:03.951441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b099048c-b4aa-4c9d-862d-f1ac1f42e93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:04.028689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 425/878] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:03 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:04.297493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5451b-83cf-46ca-8a65-4f55b729be48 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.360350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:04.400637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5451b-83cf-46ca-8a65-4f55b729be48 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.441058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcd3761-ac1b-49dd-9e3c-0befcaac2ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.442564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3761-ac1b-49dd-9e3c-0befcaac2ab9 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.442840 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3761-ac1b-49dd-9e3c-0befcaac2ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.443107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcd3761-ac1b-49dd-9e3c-0befcaac2ab9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.456126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcd3761-ac1b-49dd-9e3c-0befcaac2ab9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-dbcd3761-ac1b-49dd-9e3c-0befcaac2ab9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:04.461082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:04.462094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:04.462946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 454/879] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:04.468711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099048c-b4aa-4c9d-862d-f1ac1f42e93c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.514490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:04.536994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae7d2-d151-4a18-80ba-e31dff74dc74 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.537317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae7d2-d151-4a18-80ba-e31dff74dc74 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.537553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dae7d2-d151-4a18-80ba-e31dff74dc74 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.540246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 455/880] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:04.544205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7f1d1-4b67-4345-b6cf-2218ff93124c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.544483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7f1d1-4b67-4345-b6cf-2218ff93124c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.544754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7f1d1-4b67-4345-b6cf-2218ff93124c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.571290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-efa7f1d1-4b67-4345-b6cf-2218ff93124c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:04.571290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-efa7f1d1-4b67-4345-b6cf-2218ff93124c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:04.580399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b099048c-b4aa-4c9d-862d-f1ac1f42e93c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.619750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a251227-822b-4f20-ad79-b4314c9f6825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.620378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251227-822b-4f20-ad79-b4314c9f6825 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.620659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251227-822b-4f20-ad79-b4314c9f6825 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.620931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a251227-822b-4f20-ad79-b4314c9f6825 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.621597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a251227-822b-4f20-ad79-b4314c9f6825 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:04.621902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a251227-822b-4f20-ad79-b4314c9f6825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:04.623266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a251227-822b-4f20-ad79-b4314c9f6825 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:04.631835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 426/881] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:04.633033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b201c-48cc-48e3-959c-a691912a3b79 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.633315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b201c-48cc-48e3-959c-a691912a3b79 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.633587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b201c-48cc-48e3-959c-a691912a3b79 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.638856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 427/882] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:04.638856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b201c-48cc-48e3-959c-a691912a3b79 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.649266 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 456/883] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:04.651328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391d501-c6d3-4ed4-b6ca-287a9a52f593 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.651782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391d501-c6d3-4ed4-b6ca-287a9a52f593 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.652349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391d501-c6d3-4ed4-b6ca-287a9a52f593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.678541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f391d501-c6d3-4ed4-b6ca-287a9a52f593 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:04.680584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f391d501-c6d3-4ed4-b6ca-287a9a52f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:04.745215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:04.746377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b201c-48cc-48e3-959c-a691912a3b79 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.749613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:04.779819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 457/884] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:04.784765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbd30-4cee-4fea-b5e9-a4c5af1b8b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.785443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbd30-4cee-4fea-b5e9-a4c5af1b8b40 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.785912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbd30-4cee-4fea-b5e9-a4c5af1b8b40 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.786187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fbd30-4cee-4fea-b5e9-a4c5af1b8b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.797089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fbd30-4cee-4fea-b5e9-a4c5af1b8b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:04.798586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fbd30-4cee-4fea-b5e9-a4c5af1b8b40 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-b79fbd30-4cee-4fea-b5e9-a4c5af1b8b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:04.814015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:04.815312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:04.816303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:04.816303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:04.816303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:04.819638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 428/885] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:04.821238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391d501-c6d3-4ed4-b6ca-287a9a52f593 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.923706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391d501-c6d3-4ed4-b6ca-287a9a52f593 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:04.963793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623133-f394-45a2-8560-d83249e50348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:04.964401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623133-f394-45a2-8560-d83249e50348 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:04.964678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623133-f394-45a2-8560-d83249e50348 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:04.964949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91623133-f394-45a2-8560-d83249e50348 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:04.965589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623133-f394-45a2-8560-d83249e50348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:04.965975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623133-f394-45a2-8560-d83249e50348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:04.967338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91623133-f394-45a2-8560-d83249e50348 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:04.969753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbd30-4cee-4fea-b5e9-a4c5af1b8b40 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:04.980086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 458/886] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:04.986638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623133-f394-45a2-8560-d83249e50348 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.036711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.100084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fbd30-4cee-4fea-b5e9-a4c5af1b8b40 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.102610 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91623133-f394-45a2-8560-d83249e50348 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.140299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02d8a-c9b2-451d-a9a2-f6b7904201e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.140936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02d8a-c9b2-451d-a9a2-f6b7904201e3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.141303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02d8a-c9b2-451d-a9a2-f6b7904201e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.141662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef02d8a-c9b2-451d-a9a2-f6b7904201e3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.142254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02d8a-c9b2-451d-a9a2-f6b7904201e3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.142584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9830104-1f33-4afc-a8d8-c84c3a8a5d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.143258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9830104-1f33-4afc-a8d8-c84c3a8a5d75 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.143558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9830104-1f33-4afc-a8d8-c84c3a8a5d75 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.143836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9830104-1f33-4afc-a8d8-c84c3a8a5d75 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.143940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef02d8a-c9b2-451d-a9a2-f6b7904201e3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.152124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9830104-1f33-4afc-a8d8-c84c3a8a5d75 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-4ef02d8a-c9b2-451d-a9a2-f6b7904201e3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:05.153266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:05.154252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:05.155165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:05.155922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9830104-1f33-4afc-a8d8-c84c3a8a5d75 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.159550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 429/887] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:05.159550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02d8a-c9b2-451d-a9a2-f6b7904201e3 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-d9830104-1f33-4afc-a8d8-c84c3a8a5d75 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:05.172342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:05.173462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:05.174963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 459/888] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:34:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:05.175588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766fa2f-9bba-4957-9943-1df1b43a1397 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.175588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766fa2f-9bba-4957-9943-1df1b43a1397 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.175785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9766fa2f-9bba-4957-9943-1df1b43a1397 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.177530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 460/889] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:05.178231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766fa2f-9bba-4957-9943-1df1b43a1397 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.191003 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.271886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef02d8a-c9b2-451d-a9a2-f6b7904201e3 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.284653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9766fa2f-9bba-4957-9943-1df1b43a1397 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.287426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.310179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97044e-849c-445b-b8ce-22738e22c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.310959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97044e-849c-445b-b8ce-22738e22c627 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.311303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97044e-849c-445b-b8ce-22738e22c627 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.311678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97044e-849c-445b-b8ce-22738e22c627 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.312342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97044e-849c-445b-b8ce-22738e22c627 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.314348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b97044e-849c-445b-b8ce-22738e22c627 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.324459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da768440-8128-466a-baba-e7b21dd14782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-8b97044e-849c-445b-b8ce-22738e22c627 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:05.324667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:05.325605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:05.326442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:05.327647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768440-8128-466a-baba-e7b21dd14782 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.327647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768440-8128-466a-baba-e7b21dd14782 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.327647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da768440-8128-466a-baba-e7b21dd14782 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.327874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 430/890] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:05.327960 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da768440-8128-466a-baba-e7b21dd14782 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:05.327960 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da768440-8128-466a-baba-e7b21dd14782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.328104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97044e-849c-445b-b8ce-22738e22c627 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.328183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da768440-8128-466a-baba-e7b21dd14782 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.332619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 461/891] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:05.333758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74bc38-c64c-4cdc-baec-3263620f1124 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.334043 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74bc38-c64c-4cdc-baec-3263620f1124 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.334314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de74bc38-c64c-4cdc-baec-3263620f1124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.351980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-de74bc38-c64c-4cdc-baec-3263620f1124 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:05.353170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-de74bc38-c64c-4cdc-baec-3263620f1124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:05.416309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.428316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 462/892] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:05.429351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74bc38-c64c-4cdc-baec-3263620f1124 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.432345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97044e-849c-445b-b8ce-22738e22c627 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.472973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7afa9d-bd0e-4b2c-9e7a-33b510372fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.473582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7afa9d-bd0e-4b2c-9e7a-33b510372fc5 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.473857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7afa9d-bd0e-4b2c-9e7a-33b510372fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.474123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7afa9d-bd0e-4b2c-9e7a-33b510372fc5 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.474849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7afa9d-bd0e-4b2c-9e7a-33b510372fc5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:05.475161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7afa9d-bd0e-4b2c-9e7a-33b510372fc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.476700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7afa9d-bd0e-4b2c-9e7a-33b510372fc5 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.498219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 431/893] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:05.499152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7afa9d-bd0e-4b2c-9e7a-33b510372fc5 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.562180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.568396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de74bc38-c64c-4cdc-baec-3263620f1124 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.607036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a45ce-3d6d-45d8-81c3-dbd00a172b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.607687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a45ce-3d6d-45d8-81c3-dbd00a172b31 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.608246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a45ce-3d6d-45d8-81c3-dbd00a172b31 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.608398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094a45ce-3d6d-45d8-81c3-dbd00a172b31 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.608995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a45ce-3d6d-45d8-81c3-dbd00a172b31 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:05.609402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a45ce-3d6d-45d8-81c3-dbd00a172b31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.610673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094a45ce-3d6d-45d8-81c3-dbd00a172b31 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.618263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7afa9d-bd0e-4b2c-9e7a-33b510372fc5 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.620517 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 463/894] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:05.621360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a45ce-3d6d-45d8-81c3-dbd00a172b31 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.655749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3009-ca2e-442f-8314-ff7a02cb9fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.657083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3009-ca2e-442f-8314-ff7a02cb9fce None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.657364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3009-ca2e-442f-8314-ff7a02cb9fce None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.657637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba3009-ca2e-442f-8314-ff7a02cb9fce None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.658295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3009-ca2e-442f-8314-ff7a02cb9fce None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:05.659132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3009-ca2e-442f-8314-ff7a02cb9fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.660504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba3009-ca2e-442f-8314-ff7a02cb9fce None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.666457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 432/895] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:05.671810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3009-ca2e-442f-8314-ff7a02cb9fce None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.680832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.725045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094a45ce-3d6d-45d8-81c3-dbd00a172b31 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.757808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c4209-502d-46e4-b41c-8100ca4aed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.758407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c4209-502d-46e4-b41c-8100ca4aed44 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.758685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c4209-502d-46e4-b41c-8100ca4aed44 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.758953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c4209-502d-46e4-b41c-8100ca4aed44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.771281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba3009-ca2e-442f-8314-ff7a02cb9fce None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.786690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.805188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c868209-6cf9-40dc-853d-11380023c236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.805889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c868209-6cf9-40dc-853d-11380023c236 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.806167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c868209-6cf9-40dc-853d-11380023c236 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.806437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c868209-6cf9-40dc-853d-11380023c236 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.807069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c868209-6cf9-40dc-853d-11380023c236 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:05.807370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c868209-6cf9-40dc-853d-11380023c236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.808756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c868209-6cf9-40dc-853d-11380023c236 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.813121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 433/896] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:05.815830 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c868209-6cf9-40dc-853d-11380023c236 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.833251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c4209-502d-46e4-b41c-8100ca4aed44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.834744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c4209-502d-46e4-b41c-8100ca4aed44 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.902945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:05.943842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c868209-6cf9-40dc-853d-11380023c236 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:05.958134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 464/897] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:05.958134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c4209-502d-46e4-b41c-8100ca4aed44 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:05.982852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9bb9b-a19c-4d41-ae87-d49c504f6442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:05.982852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9bb9b-a19c-4d41-ae87-d49c504f6442 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:05.983466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9bb9b-a19c-4d41-ae87-d49c504f6442 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:05.983466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb9bb9b-a19c-4d41-ae87-d49c504f6442 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:05.984041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9bb9b-a19c-4d41-ae87-d49c504f6442 None admin] RBAC: Adding query filter params (interface=public, service_id=e2398e1059c74dcc9f96c1264a140fcc, region_id=RegionOne) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:05.984351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9bb9b-a19c-4d41-ae87-d49c504f6442 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:05.985887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb9bb9b-a19c-4d41-ae87-d49c504f6442 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:05.992544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 434/898] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/endpoints?service_id=e2398e1059c74dcc9f96c1264a140fcc&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:05.992902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9bb9b-a19c-4d41-ae87-d49c504f6442 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.028113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.072085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c4209-502d-46e4-b41c-8100ca4aed44 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.102991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb9bb9b-a19c-4d41-ae87-d49c504f6442 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.108199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5eb32-c202-4662-aefb-cfcb6745ff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.108828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5eb32-c202-4662-aefb-cfcb6745ff6f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.109108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5eb32-c202-4662-aefb-cfcb6745ff6f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.109377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d5eb32-c202-4662-aefb-cfcb6745ff6f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.110382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5eb32-c202-4662-aefb-cfcb6745ff6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.111817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d5eb32-c202-4662-aefb-cfcb6745ff6f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-32d5eb32-c202-4662-aefb-cfcb6745ff6f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:06.122234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:06.123189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:06.124924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 465/899] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:06.125716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5eb32-c202-4662-aefb-cfcb6745ff6f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.143938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074a20d-25d8-4367-ae9c-bb2059a97fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.145218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a20d-25d8-4367-ae9c-bb2059a97fb6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.145842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a20d-25d8-4367-ae9c-bb2059a97fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.146322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a20d-25d8-4367-ae9c-bb2059a97fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.148883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.158564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074a20d-25d8-4367-ae9c-bb2059a97fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.160537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074a20d-25d8-4367-ae9c-bb2059a97fb6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-f074a20d-25d8-4367-ae9c-bb2059a97fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:06.174791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:06.175783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:06.181833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:06.181833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:06.181833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:06.181833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 435/900] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:06.181833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074a20d-25d8-4367-ae9c-bb2059a97fb6 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.235463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d5eb32-c202-4662-aefb-cfcb6745ff6f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.261362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.273424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994f1ef-36fe-48eb-97ed-2f5413d7d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.274084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994f1ef-36fe-48eb-97ed-2f5413d7d682 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.274512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994f1ef-36fe-48eb-97ed-2f5413d7d682 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.274783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994f1ef-36fe-48eb-97ed-2f5413d7d682 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.275380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994f1ef-36fe-48eb-97ed-2f5413d7d682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.276771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994f1ef-36fe-48eb-97ed-2f5413d7d682 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.282597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 466/901] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:06.283368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994f1ef-36fe-48eb-97ed-2f5413d7d682 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.294043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074a20d-25d8-4367-ae9c-bb2059a97fb6 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.337251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe0140-58f7-4df7-9eb9-3a9e162b869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.338775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe0140-58f7-4df7-9eb9-3a9e162b869b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.338775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe0140-58f7-4df7-9eb9-3a9e162b869b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.338775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe0140-58f7-4df7-9eb9-3a9e162b869b None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.339565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe0140-58f7-4df7-9eb9-3a9e162b869b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:06.339977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe0140-58f7-4df7-9eb9-3a9e162b869b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.341574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe0140-58f7-4df7-9eb9-3a9e162b869b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.347676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 436/902] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:06.353713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe0140-58f7-4df7-9eb9-3a9e162b869b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.413555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.436666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994f1ef-36fe-48eb-97ed-2f5413d7d682 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.473100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe0140-58f7-4df7-9eb9-3a9e162b869b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.485275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539785d3-78e5-4582-abe0-8211d15f895b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.486062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539785d3-78e5-4582-abe0-8211d15f895b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.486291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539785d3-78e5-4582-abe0-8211d15f895b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.486561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539785d3-78e5-4582-abe0-8211d15f895b None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.487241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539785d3-78e5-4582-abe0-8211d15f895b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:06.488438 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539785d3-78e5-4582-abe0-8211d15f895b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.489894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539785d3-78e5-4582-abe0-8211d15f895b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.503361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 467/903] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:06.508590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539785d3-78e5-4582-abe0-8211d15f895b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.518528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc5193-9d4f-4093-ae33-f662d1af67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.519208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc5193-9d4f-4093-ae33-f662d1af67dc None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.519483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc5193-9d4f-4093-ae33-f662d1af67dc None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.519775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edc5193-9d4f-4093-ae33-f662d1af67dc None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.520471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc5193-9d4f-4093-ae33-f662d1af67dc None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:06.520775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc5193-9d4f-4093-ae33-f662d1af67dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.522127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edc5193-9d4f-4093-ae33-f662d1af67dc None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.528346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 437/904] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:06.534213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc5193-9d4f-4093-ae33-f662d1af67dc None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.561550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.630493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539785d3-78e5-4582-abe0-8211d15f895b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.655084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edc5193-9d4f-4093-ae33-f662d1af67dc None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.667252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e580-bf1d-48cf-9d5e-729adda6f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.668192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e580-bf1d-48cf-9d5e-729adda6f1fe None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.668567 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e580-bf1d-48cf-9d5e-729adda6f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.668940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312e580-bf1d-48cf-9d5e-729adda6f1fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.671664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.677888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312e580-bf1d-48cf-9d5e-729adda6f1fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.679589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312e580-bf1d-48cf-9d5e-729adda6f1fe None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-f312e580-bf1d-48cf-9d5e-729adda6f1fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:06.693618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:06.694552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:06.695437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:06.695437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:06.695437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:06.695437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:06.695437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:06.695437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:06.695437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:06.695437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:06.695912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 468/905] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:06.701518 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e580-bf1d-48cf-9d5e-729adda6f1fe None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.703448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8da9b-9f58-4ae1-a4eb-a669b68c2eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.704282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8da9b-9f58-4ae1-a4eb-a669b68c2eed None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.704565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8da9b-9f58-4ae1-a4eb-a669b68c2eed None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.704835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c8da9b-9f58-4ae1-a4eb-a669b68c2eed None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.705757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8da9b-9f58-4ae1-a4eb-a669b68c2eed None admin] RBAC: Adding query filter params (interface=public, service_id=2166a47073b14471b6a4d327d1af0177, region_id=RegionOne) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:06.706043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8da9b-9f58-4ae1-a4eb-a669b68c2eed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.707820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c8da9b-9f58-4ae1-a4eb-a669b68c2eed None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.718689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 438/906] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/endpoints?service_id=2166a47073b14471b6a4d327d1af0177&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:06.721322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8da9b-9f58-4ae1-a4eb-a669b68c2eed None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.814663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312e580-bf1d-48cf-9d5e-729adda6f1fe None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.825188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:06.848229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c8da9b-9f58-4ae1-a4eb-a669b68c2eed None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:06.849620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9003408-cbfd-4f77-bf60-a4914e1c637b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.850444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003408-cbfd-4f77-bf60-a4914e1c637b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.850910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003408-cbfd-4f77-bf60-a4914e1c637b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.851182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003408-cbfd-4f77-bf60-a4914e1c637b None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.851898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9003408-cbfd-4f77-bf60-a4914e1c637b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:06.852209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9003408-cbfd-4f77-bf60-a4914e1c637b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.853625 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9003408-cbfd-4f77-bf60-a4914e1c637b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.871720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 469/907] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:06.875550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9003408-cbfd-4f77-bf60-a4914e1c637b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:06.891647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509af5eb-6351-4d78-b2b6-e25ea75d2e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:06.892626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509af5eb-6351-4d78-b2b6-e25ea75d2e62 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:06.893213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509af5eb-6351-4d78-b2b6-e25ea75d2e62 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:06.893625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509af5eb-6351-4d78-b2b6-e25ea75d2e62 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:06.894427 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509af5eb-6351-4d78-b2b6-e25ea75d2e62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:06.895936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509af5eb-6351-4d78-b2b6-e25ea75d2e62 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:06.902168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 439/908] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:34:06.983131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9003408-cbfd-4f77-bf60-a4914e1c637b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:07.025371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a3c3b-a456-4237-a2e6-a2e3a0253801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:07.025984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3c3b-a456-4237-a2e6-a2e3a0253801 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:07.026266 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3c3b-a456-4237-a2e6-a2e3a0253801 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:07.026530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a3c3b-a456-4237-a2e6-a2e3a0253801 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:07.027264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3c3b-a456-4237-a2e6-a2e3a0253801 None admin] RBAC: Adding query filter params (role.id=a59bc76b7fc940959bb53b88e59e985c, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=c429ad73f92e4f6d995198189b64406b) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:07.027600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3c3b-a456-4237-a2e6-a2e3a0253801 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:07.029039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a3c3b-a456-4237-a2e6-a2e3a0253801 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:07.036396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 470/909] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:06 2022] GET /identity/v3/role_assignments?user.id=c429ad73f92e4f6d995198189b64406b&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=a59bc76b7fc940959bb53b88e59e985c => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:08.022177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e76e-3e09-40e9-a258-c813e8631868 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.022763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e76e-3e09-40e9-a258-c813e8631868 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.022763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7786e76e-3e09-40e9-a258-c813e8631868 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.024310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 440/910] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:08.029678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a89a0-eeb2-44a0-9a86-37d359bddf3c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.030077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a89a0-eeb2-44a0-9a86-37d359bddf3c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.030246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a89a0-eeb2-44a0-9a86-37d359bddf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.048390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-980a89a0-eeb2-44a0-9a86-37d359bddf3c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:08.050085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-980a89a0-eeb2-44a0-9a86-37d359bddf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:08.076443 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:08.123838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 471/911] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:08 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:08.388111 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e76e-3e09-40e9-a258-c813e8631868 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:08.439472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:08.500641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7786e76e-3e09-40e9-a258-c813e8631868 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:08.538439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655a2aa8-30b1-42b9-a3c3-19d60c24625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:08.539052 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2aa8-30b1-42b9-a3c3-19d60c24625f None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.539336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2aa8-30b1-42b9-a3c3-19d60c24625f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.539640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655a2aa8-30b1-42b9-a3c3-19d60c24625f None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.540307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a2aa8-30b1-42b9-a3c3-19d60c24625f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:08.541664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655a2aa8-30b1-42b9-a3c3-19d60c24625f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:08.615886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad223f7-9884-4065-bcab-1edeec7ccd27 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.616205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad223f7-9884-4065-bcab-1edeec7ccd27 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.616449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad223f7-9884-4065-bcab-1edeec7ccd27 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.617562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 441/912] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:08 2022] POST /identity/v3/services => generated 241 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:08.617937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 472/913] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:08.625946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3796999-53df-4a4f-8989-b66e4f796f6c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:08.629917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3796999-53df-4a4f-8989-b66e4f796f6c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:08.629917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3796999-53df-4a4f-8989-b66e4f796f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:08.649214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b3796999-53df-4a4f-8989-b66e4f796f6c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:08.650827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b3796999-53df-4a4f-8989-b66e4f796f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:08.737104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 442/914] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:09.010373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad223f7-9884-4065-bcab-1edeec7ccd27 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.119630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad223f7-9884-4065-bcab-1edeec7ccd27 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.135299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8590b-1f5f-4d91-a357-6afbc6c40036 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.135885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8590b-1f5f-4d91-a357-6afbc6c40036 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.135885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8590b-1f5f-4d91-a357-6afbc6c40036 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.137579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 443/915] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:09.143333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4856856-b072-4cb9-8aa8-34b21f2a9f4a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.143692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4856856-b072-4cb9-8aa8-34b21f2a9f4a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.143920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4856856-b072-4cb9-8aa8-34b21f2a9f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.169633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a4856856-b072-4cb9-8aa8-34b21f2a9f4a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:09.170842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a4856856-b072-4cb9-8aa8-34b21f2a9f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:09.178163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6940-6042-4dcb-b448-9f6ec9126416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.179065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6940-6042-4dcb-b448-9f6ec9126416 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.179612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6940-6042-4dcb-b448-9f6ec9126416 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.180098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a6940-6042-4dcb-b448-9f6ec9126416 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.180929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a6940-6042-4dcb-b448-9f6ec9126416 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.182483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a6940-6042-4dcb-b448-9f6ec9126416 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-be4a6940-6042-4dcb-b448-9f6ec9126416 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:09.191599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:09.192685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:09.194209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 473/916] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:09.198829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6940-6042-4dcb-b448-9f6ec9126416 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.202527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.230079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.258153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 444/917] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:09.264060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2ec79-7c88-43d6-9c00-11684b1d1edf None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.264060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2ec79-7c88-43d6-9c00-11684b1d1edf None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.264060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba2ec79-7c88-43d6-9c00-11684b1d1edf None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.264060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 445/918] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:09.268152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed947946-abe8-46bc-8320-b687f74c8930 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.268443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed947946-abe8-46bc-8320-b687f74c8930 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.268884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed947946-abe8-46bc-8320-b687f74c8930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.291562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ed947946-abe8-46bc-8320-b687f74c8930 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:09.298939 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ed947946-abe8-46bc-8320-b687f74c8930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:09.310067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a6940-6042-4dcb-b448-9f6ec9126416 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.345733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac686f-ff48-4436-bb38-ee0c01651187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.346909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac686f-ff48-4436-bb38-ee0c01651187 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.347194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac686f-ff48-4436-bb38-ee0c01651187 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.347460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ac686f-ff48-4436-bb38-ee0c01651187 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.348115 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac686f-ff48-4436-bb38-ee0c01651187 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:09.348416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac686f-ff48-4436-bb38-ee0c01651187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.349769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ac686f-ff48-4436-bb38-ee0c01651187 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.359296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 474/919] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:09.360323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac686f-ff48-4436-bb38-ee0c01651187 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.375677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 446/920] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:09.457009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.466674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ac686f-ff48-4436-bb38-ee0c01651187 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.505982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c28286-d124-4217-b40a-5885f304df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.506587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c28286-d124-4217-b40a-5885f304df73 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.506867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c28286-d124-4217-b40a-5885f304df73 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.507136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c28286-d124-4217-b40a-5885f304df73 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.507803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c28286-d124-4217-b40a-5885f304df73 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:09.508104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c28286-d124-4217-b40a-5885f304df73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.509465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c28286-d124-4217-b40a-5885f304df73 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.514608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 475/921] 10.222.0.25 () {56 vars in 1114 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:09.520588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed947946-abe8-46bc-8320-b687f74c8930 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.529643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c28286-d124-4217-b40a-5885f304df73 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.630442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.644352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed947946-abe8-46bc-8320-b687f74c8930 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.647579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c28286-d124-4217-b40a-5885f304df73 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.678449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f7ad7-b82f-4c0f-8135-33460967ff50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.679090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f7ad7-b82f-4c0f-8135-33460967ff50 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.679365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f7ad7-b82f-4c0f-8135-33460967ff50 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.679656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f7ad7-b82f-4c0f-8135-33460967ff50 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.680245 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f7ad7-b82f-4c0f-8135-33460967ff50 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.681829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f7ad7-b82f-4c0f-8135-33460967ff50 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.684336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045b2cc-f871-47e1-8f55-139838a9b5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.685218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045b2cc-f871-47e1-8f55-139838a9b5b1 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.685736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045b2cc-f871-47e1-8f55-139838a9b5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.686221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045b2cc-f871-47e1-8f55-139838a9b5b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.687086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045b2cc-f871-47e1-8f55-139838a9b5b1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.688662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8045b2cc-f871-47e1-8f55-139838a9b5b1 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-875f7ad7-b82f-4c0f-8135-33460967ff50 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:09.690833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:09.691787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 04 08:34:09.692657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:09.696956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 476/922] 10.222.0.25 () {56 vars in 1132 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:09.697775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f7ad7-b82f-4c0f-8135-33460967ff50 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.717184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.791624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 447/923] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:09.791624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045b2cc-f871-47e1-8f55-139838a9b5b1 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.808924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f7ad7-b82f-4c0f-8135-33460967ff50 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.856803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e071836-becb-4ecf-b95b-f5e4b8a15592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.857435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071836-becb-4ecf-b95b-f5e4b8a15592 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.857716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071836-becb-4ecf-b95b-f5e4b8a15592 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.857989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071836-becb-4ecf-b95b-f5e4b8a15592 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.858927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e071836-becb-4ecf-b95b-f5e4b8a15592 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:09.859721 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e071836-becb-4ecf-b95b-f5e4b8a15592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:09.861440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e071836-becb-4ecf-b95b-f5e4b8a15592 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:09.869686 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 477/924] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:09.875496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e071836-becb-4ecf-b95b-f5e4b8a15592 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.916164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8045b2cc-f871-47e1-8f55-139838a9b5b1 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:09.953852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3c4ef-2710-403f-a2c1-a80732f4c4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:09.954629 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3c4ef-2710-403f-a2c1-a80732f4c4ef None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:09.954977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3c4ef-2710-403f-a2c1-a80732f4c4ef None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:09.955762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3c4ef-2710-403f-a2c1-a80732f4c4ef None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:09.970058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3c4ef-2710-403f-a2c1-a80732f4c4ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-a3f3c4ef-2710-403f-a2c1-a80732f4c4ef None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:09.976408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:09.977431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:09.978276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:09.982564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 448/925] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:09.983470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:09.983597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3c4ef-2710-403f-a2c1-a80732f4c4ef None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:09.989003 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:10.014547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e071836-becb-4ecf-b95b-f5e4b8a15592 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.061156 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80e5ad-73ef-483d-a8c2-a5fa9c57cce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.061700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80e5ad-73ef-483d-a8c2-a5fa9c57cce4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.063701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80e5ad-73ef-483d-a8c2-a5fa9c57cce4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.063701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a80e5ad-73ef-483d-a8c2-a5fa9c57cce4 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.063701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80e5ad-73ef-483d-a8c2-a5fa9c57cce4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:10.063701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80e5ad-73ef-483d-a8c2-a5fa9c57cce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.064631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a80e5ad-73ef-483d-a8c2-a5fa9c57cce4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.069875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 478/926] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:10.076640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80e5ad-73ef-483d-a8c2-a5fa9c57cce4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.116251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3c4ef-2710-403f-a2c1-a80732f4c4ef None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.153369 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a62a-b48e-47b0-ba68-fb76a716f25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.154017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a62a-b48e-47b0-ba68-fb76a716f25f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.154258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a62a-b48e-47b0-ba68-fb76a716f25f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.154493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8a62a-b48e-47b0-ba68-fb76a716f25f None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.155157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a62a-b48e-47b0-ba68-fb76a716f25f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:10.155450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a62a-b48e-47b0-ba68-fb76a716f25f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.156946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8a62a-b48e-47b0-ba68-fb76a716f25f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.166233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 449/927] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:10.172063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a62a-b48e-47b0-ba68-fb76a716f25f None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.204965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a80e5ad-73ef-483d-a8c2-a5fa9c57cce4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.241301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96c39a-ff3e-47d1-9898-f98c7449ff57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.241752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96c39a-ff3e-47d1-9898-f98c7449ff57 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.242034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96c39a-ff3e-47d1-9898-f98c7449ff57 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.242302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c96c39a-ff3e-47d1-9898-f98c7449ff57 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.242973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96c39a-ff3e-47d1-9898-f98c7449ff57 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.244370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c96c39a-ff3e-47d1-9898-f98c7449ff57 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.264338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:10.298515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8a62a-b48e-47b0-ba68-fb76a716f25f None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.331918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10bb61-19cf-43e5-b529-7fec63163d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.332481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10bb61-19cf-43e5-b529-7fec63163d4b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.332761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10bb61-19cf-43e5-b529-7fec63163d4b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.333035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c10bb61-19cf-43e5-b529-7fec63163d4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.344229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:10.346056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10bb61-19cf-43e5-b529-7fec63163d4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.347810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c10bb61-19cf-43e5-b529-7fec63163d4b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.352357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 479/928] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-2c10bb61-19cf-43e5-b529-7fec63163d4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:10.363186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:10.364307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:10.365216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:10.365216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:10.365216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:10.365216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 450/929] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:10.373501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96c39a-ff3e-47d1-9898-f98c7449ff57 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.496233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c96c39a-ff3e-47d1-9898-f98c7449ff57 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.534935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da80412-8ad0-4c58-9b73-931cda29f934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.535853 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da80412-8ad0-4c58-9b73-931cda29f934 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.536293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da80412-8ad0-4c58-9b73-931cda29f934 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.536716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da80412-8ad0-4c58-9b73-931cda29f934 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.537362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da80412-8ad0-4c58-9b73-931cda29f934 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:10.537679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da80412-8ad0-4c58-9b73-931cda29f934 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.539015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da80412-8ad0-4c58-9b73-931cda29f934 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.552188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 480/930] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:10.557458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10bb61-19cf-43e5-b529-7fec63163d4b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.671368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c10bb61-19cf-43e5-b529-7fec63163d4b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.699319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:10.708081 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddc61e0-5fd6-4d13-bf17-875ded33992e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.708710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc61e0-5fd6-4d13-bf17-875ded33992e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.708985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc61e0-5fd6-4d13-bf17-875ded33992e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.709256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddc61e0-5fd6-4d13-bf17-875ded33992e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.716980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc61e0-5fd6-4d13-bf17-875ded33992e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.718459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddc61e0-5fd6-4d13-bf17-875ded33992e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-2ddc61e0-5fd6-4d13-bf17-875ded33992e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:10.730162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:10.731203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:10.732195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 451/931] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:10.737874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da80412-8ad0-4c58-9b73-931cda29f934 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.800367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:10.848233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da80412-8ad0-4c58-9b73-931cda29f934 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:10.883233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732327df-93b2-46c2-ae83-2fdbc74dbe8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:10.883870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732327df-93b2-46c2-ae83-2fdbc74dbe8b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.884150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732327df-93b2-46c2-ae83-2fdbc74dbe8b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.884423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732327df-93b2-46c2-ae83-2fdbc74dbe8b None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.885224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732327df-93b2-46c2-ae83-2fdbc74dbe8b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:10.885531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732327df-93b2-46c2-ae83-2fdbc74dbe8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:10.886313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17effe-f9f5-4f12-84ea-e4e2aaa3cc23 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.886601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17effe-f9f5-4f12-84ea-e4e2aaa3cc23 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.886877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff17effe-f9f5-4f12-84ea-e4e2aaa3cc23 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.886976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732327df-93b2-46c2-ae83-2fdbc74dbe8b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:10.888381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 452/932] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:10.893313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84797aa4-372c-4397-9967-565b79f46229 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:10.893593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84797aa4-372c-4397-9967-565b79f46229 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:10.893869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84797aa4-372c-4397-9967-565b79f46229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:10.905867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 481/933] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:10.911934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732327df-93b2-46c2-ae83-2fdbc74dbe8b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:10.913975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-84797aa4-372c-4397-9967-565b79f46229 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:10.915159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-84797aa4-372c-4397-9967-565b79f46229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:10.991833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 453/934] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:11.010878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732327df-93b2-46c2-ae83-2fdbc74dbe8b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.025318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.045474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93886-1876-4517-924c-bb259afec1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.046099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93886-1876-4517-924c-bb259afec1cd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.046371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93886-1876-4517-924c-bb259afec1cd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.046643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b93886-1876-4517-924c-bb259afec1cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.056744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b93886-1876-4517-924c-bb259afec1cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.058171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b93886-1876-4517-924c-bb259afec1cd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-12b93886-1876-4517-924c-bb259afec1cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:11.072220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:11.073165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:11.074076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:11.074076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:11.074076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:11.074076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 482/935] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:11.079126 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84797aa4-372c-4397-9967-565b79f46229 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.179572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84797aa4-372c-4397-9967-565b79f46229 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.189165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.214392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0935-5643-42e7-a816-cb843925a756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.214995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0935-5643-42e7-a816-cb843925a756 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.215271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0935-5643-42e7-a816-cb843925a756 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.215560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90df0935-5643-42e7-a816-cb843925a756 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.216203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df0935-5643-42e7-a816-cb843925a756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:11.216501 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df0935-5643-42e7-a816-cb843925a756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.217857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90df0935-5643-42e7-a816-cb843925a756 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.234350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 454/936] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:11.235723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93886-1876-4517-924c-bb259afec1cd None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.290642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0935-5643-42e7-a816-cb843925a756 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.340589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b93886-1876-4517-924c-bb259afec1cd None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.378137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7124-3c67-4722-9ee4-fc25aa96534e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.378932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7124-3c67-4722-9ee4-fc25aa96534e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.379312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7124-3c67-4722-9ee4-fc25aa96534e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.379728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ef7124-3c67-4722-9ee4-fc25aa96534e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.386506 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7124-3c67-4722-9ee4-fc25aa96534e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.388125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ef7124-3c67-4722-9ee4-fc25aa96534e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-74ef7124-3c67-4722-9ee4-fc25aa96534e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:11.400006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:11.401092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:11.402222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:11.402222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:11.402222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:11.402222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:11.402222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:11.402222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:11.402222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:11.402222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:11.403096 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90df0935-5643-42e7-a816-cb843925a756 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.408175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 483/937] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:11.409741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7124-3c67-4722-9ee4-fc25aa96534e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.435883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.441164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afabc7-98e5-421d-bfa9-f79837c611a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.442004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afabc7-98e5-421d-bfa9-f79837c611a8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.442479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afabc7-98e5-421d-bfa9-f79837c611a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.442984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07afabc7-98e5-421d-bfa9-f79837c611a8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.443967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afabc7-98e5-421d-bfa9-f79837c611a8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.445515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07afabc7-98e5-421d-bfa9-f79837c611a8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-07afabc7-98e5-421d-bfa9-f79837c611a8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:11.454572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:11.456167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:11.457006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:11.464316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 455/938] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:11.465739 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afabc7-98e5-421d-bfa9-f79837c611a8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.513345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ef7124-3c67-4722-9ee4-fc25aa96534e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.515852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.554210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f272e5-df27-4dde-997b-1facfae5f741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.554814 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f272e5-df27-4dde-997b-1facfae5f741 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.555139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f272e5-df27-4dde-997b-1facfae5f741 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.555415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f272e5-df27-4dde-997b-1facfae5f741 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.556423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f272e5-df27-4dde-997b-1facfae5f741 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:11.556727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f272e5-df27-4dde-997b-1facfae5f741 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.558150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f272e5-df27-4dde-997b-1facfae5f741 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.573311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 484/939] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:11.583770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07afabc7-98e5-421d-bfa9-f79837c611a8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.584166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f272e5-df27-4dde-997b-1facfae5f741 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.624170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa0001-d0da-42bc-9cd7-20a10e2dad1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.625121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa0001-d0da-42bc-9cd7-20a10e2dad1b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.625647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa0001-d0da-42bc-9cd7-20a10e2dad1b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.626171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa0001-d0da-42bc-9cd7-20a10e2dad1b None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.627005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa0001-d0da-42bc-9cd7-20a10e2dad1b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:11.628044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa0001-d0da-42bc-9cd7-20a10e2dad1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.629676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa0001-d0da-42bc-9cd7-20a10e2dad1b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.639641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 456/940] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:11.640765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa0001-d0da-42bc-9cd7-20a10e2dad1b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.693053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.714338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f272e5-df27-4dde-997b-1facfae5f741 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.742211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:11.748909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa0001-d0da-42bc-9cd7-20a10e2dad1b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.758453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcc0b2-c3ab-4939-a0ee-71e2a810dcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.759114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcc0b2-c3ab-4939-a0ee-71e2a810dcf3 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.759390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcc0b2-c3ab-4939-a0ee-71e2a810dcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.759690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dcc0b2-c3ab-4939-a0ee-71e2a810dcf3 None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/c429ad73f92e4f6d995198189b64406b/roles/a59bc76b7fc940959bb53b88e59e985c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.762517 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcc0b2-c3ab-4939-a0ee-71e2a810dcf3 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=c429ad73f92e4f6d995198189b64406b, role_id=a59bc76b7fc940959bb53b88e59e985c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.764277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dcc0b2-c3ab-4939-a0ee-71e2a810dcf3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.786965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a5a36-105a-4e10-8351-bc04ae0cc6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.787714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a5a36-105a-4e10-8351-bc04ae0cc6e4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.787978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a5a36-105a-4e10-8351-bc04ae0cc6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.788248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5a5a36-105a-4e10-8351-bc04ae0cc6e4 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.788937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a5a36-105a-4e10-8351-bc04ae0cc6e4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:11.789244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a5a36-105a-4e10-8351-bc04ae0cc6e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.790704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5a5a36-105a-4e10-8351-bc04ae0cc6e4 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.801478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 457/941] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:11.802613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a5a36-105a-4e10-8351-bc04ae0cc6e4 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:11.839153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 485/942] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:11 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/c429ad73f92e4f6d995198189b64406b/roles/a59bc76b7fc940959bb53b88e59e985c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:11.923057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5a5a36-105a-4e10-8351-bc04ae0cc6e4 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:11.962031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79dc373-1b11-4969-8357-6a6ae277d591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:11.962995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dc373-1b11-4969-8357-6a6ae277d591 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:11.963477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dc373-1b11-4969-8357-6a6ae277d591 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:11.964008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79dc373-1b11-4969-8357-6a6ae277d591 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:11.965037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dc373-1b11-4969-8357-6a6ae277d591 None admin] RBAC: Adding query filter params (interface=public, service_id=84fb0466b265480b93f5ebb46cb91613, region_id=RegionOne) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:11.965616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dc373-1b11-4969-8357-6a6ae277d591 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:11.967258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79dc373-1b11-4969-8357-6a6ae277d591 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:11.973707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 458/943] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/endpoints?service_id=84fb0466b265480b93f5ebb46cb91613&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:11.979969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcc0b2-c3ab-4939-a0ee-71e2a810dcf3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.096374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dcc0b2-c3ab-4939-a0ee-71e2a810dcf3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.132221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e937d5-8555-4a8e-a6ed-860dbd3ebb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.132842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e937d5-8555-4a8e-a6ed-860dbd3ebb26 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.133125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e937d5-8555-4a8e-a6ed-860dbd3ebb26 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.133395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e937d5-8555-4a8e-a6ed-860dbd3ebb26 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.134006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e937d5-8555-4a8e-a6ed-860dbd3ebb26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.135372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e937d5-8555-4a8e-a6ed-860dbd3ebb26 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.141852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 486/944] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:11 2022] GET /identity/v3/services => generated 1497 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:34:12.169259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795851-c2ad-4597-bfe6-fe80bd58ad73 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.169609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795851-c2ad-4597-bfe6-fe80bd58ad73 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.169808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89795851-c2ad-4597-bfe6-fe80bd58ad73 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.171575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 459/945] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:12.177833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bb143-3565-4f86-99c9-5432d50608ec None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.178124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bb143-3565-4f86-99c9-5432d50608ec None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.178400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3bb143-3565-4f86-99c9-5432d50608ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.197672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-de3bb143-3565-4f86-99c9-5432d50608ec None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:12.198886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-de3bb143-3565-4f86-99c9-5432d50608ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:12.201227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.275552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 487/946] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:12.553919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795851-c2ad-4597-bfe6-fe80bd58ad73 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.579950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.657775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4381ea-dbe2-4ba3-9468-f9708a495c9c None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.658099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4381ea-dbe2-4ba3-9468-f9708a495c9c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.658894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4381ea-dbe2-4ba3-9468-f9708a495c9c None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.660551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 488/947] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:12.665465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeec6b-1872-4c5f-a8ac-53e17f5b9193 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.665749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeec6b-1872-4c5f-a8ac-53e17f5b9193 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.666027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeec6b-1872-4c5f-a8ac-53e17f5b9193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.671502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89795851-c2ad-4597-bfe6-fe80bd58ad73 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.684815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-6abeec6b-1872-4c5f-a8ac-53e17f5b9193 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:12.686327 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6abeec6b-1872-4c5f-a8ac-53e17f5b9193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:12.709721 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.710336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.710624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.710933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.711551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.712979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.715847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING keystone.server.flask.common [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 04 08:34:12.759071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 489/948] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:12.764866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.sql.core [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:34:12.764866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 08:34:12.764866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [parameters: {'id': 'f9a6b2424a6a4ec6aec0505db2f78458', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 08:34:12.764866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88128) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9a6b2424a6a4ec6aec0505db2f78458.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9a6b2424a6a4ec6aec0505db2f78458. Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:34:12.784077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application result.read() Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 04 08:34:12.784944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application yield resource Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise self.value Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application session.commit() Oct 04 08:34:12.785954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:34:12.786824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:34:12.787742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application result.read() Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:34:12.788551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [parameters: {'id': 'f9a6b2424a6a4ec6aec0505db2f78458', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.789426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:12.790211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9a6b2424a6a4ec6aec0505db2f78458. Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:12.800209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 460/949] 10.222.0.25 () {60 vars in 1140 bytes} [Tue Oct 4 08:34:12 2022] POST /identity/v3/projects => generated 262 bytes in 241 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:12.804864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeec6b-1872-4c5f-a8ac-53e17f5b9193 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:12.882880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:12.920027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeec6b-1872-4c5f-a8ac-53e17f5b9193 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:12.955905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad411853-f3d3-4423-90ea-fea02499b3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:12.956536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad411853-f3d3-4423-90ea-fea02499b3aa None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:12.956815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad411853-f3d3-4423-90ea-fea02499b3aa None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:12.957085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad411853-f3d3-4423-90ea-fea02499b3aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:12.963745 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad411853-f3d3-4423-90ea-fea02499b3aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:12.965188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad411853-f3d3-4423-90ea-fea02499b3aa None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-ad411853-f3d3-4423-90ea-fea02499b3aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:12.976339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:12.977407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:12.978569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:12.978569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:12.978569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:12.978569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:12.978569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:12.978569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:12.978569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:12.978569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:12.978569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 490/950] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:12.985272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.074382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad411853-f3d3-4423-90ea-fea02499b3aa None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.076748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:13.101418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d45a91-e4ed-4412-b4be-030322fff113 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.140706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8642-833f-4f6e-9bf9-8f6d6063209d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.141680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8642-833f-4f6e-9bf9-8f6d6063209d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.142215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8642-833f-4f6e-9bf9-8f6d6063209d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.143268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c8642-833f-4f6e-9bf9-8f6d6063209d None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.144173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8642-833f-4f6e-9bf9-8f6d6063209d None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:13.144696 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8642-833f-4f6e-9bf9-8f6d6063209d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.146566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c8642-833f-4f6e-9bf9-8f6d6063209d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.171930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 461/951] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:12 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:13.196001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad411853-f3d3-4423-90ea-fea02499b3aa None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.226324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:13.235316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100870da-4eb8-414b-b0cf-0f238cb7ef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.244412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100870da-4eb8-414b-b0cf-0f238cb7ef7e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.244412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100870da-4eb8-414b-b0cf-0f238cb7ef7e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.244412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100870da-4eb8-414b-b0cf-0f238cb7ef7e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.244412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100870da-4eb8-414b-b0cf-0f238cb7ef7e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.244412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100870da-4eb8-414b-b0cf-0f238cb7ef7e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-100870da-4eb8-414b-b0cf-0f238cb7ef7e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:13.248604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:13.249752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:13.250928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 491/952] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:13.259120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8642-833f-4f6e-9bf9-8f6d6063209d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.376015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c8642-833f-4f6e-9bf9-8f6d6063209d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.414542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d9918-9da0-4c96-ae2f-6275bbe7f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.415161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d9918-9da0-4c96-ae2f-6275bbe7f267 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.415445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d9918-9da0-4c96-ae2f-6275bbe7f267 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.415752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d9918-9da0-4c96-ae2f-6275bbe7f267 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.418883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d9918-9da0-4c96-ae2f-6275bbe7f267 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:13.418883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d9918-9da0-4c96-ae2f-6275bbe7f267 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.418883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d9918-9da0-4c96-ae2f-6275bbe7f267 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.423577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 462/953] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:13.430167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100870da-4eb8-414b-b0cf-0f238cb7ef7e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:13.540338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100870da-4eb8-414b-b0cf-0f238cb7ef7e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:13.576883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ca913-1e27-4cc5-99a8-5380293357a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:13.577498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ca913-1e27-4cc5-99a8-5380293357a2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:13.577780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ca913-1e27-4cc5-99a8-5380293357a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:13.578053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ca913-1e27-4cc5-99a8-5380293357a2 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:13.578688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ca913-1e27-4cc5-99a8-5380293357a2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:13.578995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ca913-1e27-4cc5-99a8-5380293357a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:13.580427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ca913-1e27-4cc5-99a8-5380293357a2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:13.585641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 492/954] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:14.162537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b029ba-7ce1-4cfc-ad0b-fdf82ddd905e None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.163089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b029ba-7ce1-4cfc-ad0b-fdf82ddd905e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.163089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b029ba-7ce1-4cfc-ad0b-fdf82ddd905e None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.164701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 463/955] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:14.169803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abad43f-c410-49df-a7f6-2d24adac90f9 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.170092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abad43f-c410-49df-a7f6-2d24adac90f9 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.170370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abad43f-c410-49df-a7f6-2d24adac90f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.190075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-3abad43f-c410-49df-a7f6-2d24adac90f9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:14.191240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3abad43f-c410-49df-a7f6-2d24adac90f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:14.246688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:14.266866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 493/956] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:14.367690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82da07-0d3c-40ca-b89e-254dae3dcef9 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.368053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82da07-0d3c-40ca-b89e-254dae3dcef9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.368244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a82da07-0d3c-40ca-b89e-254dae3dcef9 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.369816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 464/957] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:14.376871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace636-7f6d-4fa6-a54f-08b7d1dbfec2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.378020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace636-7f6d-4fa6-a54f-08b7d1dbfec2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.378383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aace636-7f6d-4fa6-a54f-08b7d1dbfec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.396446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8aace636-7f6d-4fa6-a54f-08b7d1dbfec2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:14.397606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8aace636-7f6d-4fa6-a54f-08b7d1dbfec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:14.464229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 494/958] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:14.536994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82da07-0d3c-40ca-b89e-254dae3dcef9 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:14.541904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:14.641455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a82da07-0d3c-40ca-b89e-254dae3dcef9 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:14.676020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c17870-d9a9-410d-bb80-1faa39851a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:14.676904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c17870-d9a9-410d-bb80-1faa39851a13 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.677183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c17870-d9a9-410d-bb80-1faa39851a13 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.677442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c17870-d9a9-410d-bb80-1faa39851a13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.687606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c17870-d9a9-410d-bb80-1faa39851a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-39c17870-d9a9-410d-bb80-1faa39851a13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:14.692600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:14.693527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:14.694520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 465/959] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:14.699577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aace636-7f6d-4fa6-a54f-08b7d1dbfec2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:14.746506 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c17870-d9a9-410d-bb80-1faa39851a13 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:14.810727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aace636-7f6d-4fa6-a54f-08b7d1dbfec2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:14.822308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:14.831053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:14.856747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cdd43-2e3d-4ccb-9000-3f8d5d2c3f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:14.857366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cdd43-2e3d-4ccb-9000-3f8d5d2c3f94 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.857635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cdd43-2e3d-4ccb-9000-3f8d5d2c3f94 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.857954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cdd43-2e3d-4ccb-9000-3f8d5d2c3f94 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.858767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cdd43-2e3d-4ccb-9000-3f8d5d2c3f94 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:14.859118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cdd43-2e3d-4ccb-9000-3f8d5d2c3f94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:14.861132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cdd43-2e3d-4ccb-9000-3f8d5d2c3f94 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:14.866163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c17870-d9a9-410d-bb80-1faa39851a13 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:14.871196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 495/960] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:14.876620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cdd43-2e3d-4ccb-9000-3f8d5d2c3f94 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:14.909302 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24c4ec-665a-4ded-afde-b11240c409f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:14.910356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24c4ec-665a-4ded-afde-b11240c409f6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:14.910636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24c4ec-665a-4ded-afde-b11240c409f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:14.910911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd24c4ec-665a-4ded-afde-b11240c409f6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:14.911807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24c4ec-665a-4ded-afde-b11240c409f6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:14.913423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd24c4ec-665a-4ded-afde-b11240c409f6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-fd24c4ec-665a-4ded-afde-b11240c409f6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:14.924413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:14.925493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:14.926901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 466/961] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:14.940461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24c4ec-665a-4ded-afde-b11240c409f6 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.006178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cdd43-2e3d-4ccb-9000-3f8d5d2c3f94 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.056829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c89d-c524-46d1-ada1-1fbdf6f79313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.058019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c89d-c524-46d1-ada1-1fbdf6f79313 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.058911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c89d-c524-46d1-ada1-1fbdf6f79313 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.059570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f535c89d-c524-46d1-ada1-1fbdf6f79313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.068011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd24c4ec-665a-4ded-afde-b11240c409f6 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.074681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535c89d-c524-46d1-ada1-1fbdf6f79313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.076927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f535c89d-c524-46d1-ada1-1fbdf6f79313 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-f535c89d-c524-46d1-ada1-1fbdf6f79313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:15.095399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:15.096973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:15.097880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:15.097880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:15.097880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:15.102111 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 496/962] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:15.103084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c89d-c524-46d1-ada1-1fbdf6f79313 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.105544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:15.117174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9a7a8-bb48-4852-9e21-0300e8020d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.118355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9a7a8-bb48-4852-9e21-0300e8020d52 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.118804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9a7a8-bb48-4852-9e21-0300e8020d52 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.119243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa9a7a8-bb48-4852-9e21-0300e8020d52 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.120147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9a7a8-bb48-4852-9e21-0300e8020d52 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:15.124843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9a7a8-bb48-4852-9e21-0300e8020d52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.124843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa9a7a8-bb48-4852-9e21-0300e8020d52 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.129389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 467/963] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:15.134651 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9a7a8-bb48-4852-9e21-0300e8020d52 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.142490 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:15.240245 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f535c89d-c524-46d1-ada1-1fbdf6f79313 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.260730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa9a7a8-bb48-4852-9e21-0300e8020d52 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.285868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12786359-3ccc-415c-a8ad-4bb904ac06da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.286599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12786359-3ccc-415c-a8ad-4bb904ac06da None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.286938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12786359-3ccc-415c-a8ad-4bb904ac06da None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.287221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12786359-3ccc-415c-a8ad-4bb904ac06da None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.288282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12786359-3ccc-415c-a8ad-4bb904ac06da None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:15.288593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12786359-3ccc-415c-a8ad-4bb904ac06da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.290645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12786359-3ccc-415c-a8ad-4bb904ac06da None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.303560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d845ab-6ca5-4546-82d8-21dd45e08df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.304481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d845ab-6ca5-4546-82d8-21dd45e08df2 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.304968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d845ab-6ca5-4546-82d8-21dd45e08df2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.307549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d845ab-6ca5-4546-82d8-21dd45e08df2 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.307683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 497/964] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:15.310642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d845ab-6ca5-4546-82d8-21dd45e08df2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:15.311036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d845ab-6ca5-4546-82d8-21dd45e08df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.311288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12786359-3ccc-415c-a8ad-4bb904ac06da None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.312704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d845ab-6ca5-4546-82d8-21dd45e08df2 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.323882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 468/965] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:15.325434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d845ab-6ca5-4546-82d8-21dd45e08df2 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.397883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:15.428839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:15.441508 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12786359-3ccc-415c-a8ad-4bb904ac06da None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.466679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d845ab-6ca5-4546-82d8-21dd45e08df2 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.480224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e1a1b-c9c0-42f4-a120-3e5a3999bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.480858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e1a1b-c9c0-42f4-a120-3e5a3999bc73 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.482991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e1a1b-c9c0-42f4-a120-3e5a3999bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.485681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e1a1b-c9c0-42f4-a120-3e5a3999bc73 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.493731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e1a1b-c9c0-42f4-a120-3e5a3999bc73 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.495277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e1a1b-c9c0-42f4-a120-3e5a3999bc73 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-f44e1a1b-c9c0-42f4-a120-3e5a3999bc73 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:15.508037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:15.509044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 04 08:34:15.510011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:15.514111 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 498/966] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:34:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:15.515028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e1a1b-c9c0-42f4-a120-3e5a3999bc73 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.516160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82878e4b-e4b9-4905-8e72-5e70c7a90f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.517012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82878e4b-e4b9-4905-8e72-5e70c7a90f07 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.517669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82878e4b-e4b9-4905-8e72-5e70c7a90f07 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.518978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82878e4b-e4b9-4905-8e72-5e70c7a90f07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.520890 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82878e4b-e4b9-4905-8e72-5e70c7a90f07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.522503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82878e4b-e4b9-4905-8e72-5e70c7a90f07 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.619893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 469/967] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:15.619893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ab297-0269-4898-9cb5-66fe266eb295 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.619893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ab297-0269-4898-9cb5-66fe266eb295 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.619893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739ab297-0269-4898-9cb5-66fe266eb295 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.619893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 470/968] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:15.625384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dd673-d1e3-439c-b40e-37ef22534d5e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.625709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dd673-d1e3-439c-b40e-37ef22534d5e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.626291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025dd673-d1e3-439c-b40e-37ef22534d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.633604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e1a1b-c9c0-42f4-a120-3e5a3999bc73 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.648720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-025dd673-d1e3-439c-b40e-37ef22534d5e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:15.651339 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-025dd673-d1e3-439c-b40e-37ef22534d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:15.681669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bf2b3-1d95-4736-9f7a-a9834d02d2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.682289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bf2b3-1d95-4736-9f7a-a9834d02d2c1 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.682631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bf2b3-1d95-4736-9f7a-a9834d02d2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.682912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0bf2b3-1d95-4736-9f7a-a9834d02d2c1 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.683706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bf2b3-1d95-4736-9f7a-a9834d02d2c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:15.684017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bf2b3-1d95-4736-9f7a-a9834d02d2c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.685722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0bf2b3-1d95-4736-9f7a-a9834d02d2c1 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.711288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 499/969] 10.222.0.25 () {56 vars in 1149 bytes} [Tue Oct 4 08:34:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:15.712445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bf2b3-1d95-4736-9f7a-a9834d02d2c1 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:15.716511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:15.738443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 471/970] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:15.847354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0bf2b3-1d95-4736-9f7a-a9834d02d2c1 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:15.861993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b09a-8d19-47c9-8874-61116bd5196f None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.862275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b09a-8d19-47c9-8874-61116bd5196f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.862554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d38b09a-8d19-47c9-8874-61116bd5196f None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.865028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 472/971] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:15.873776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205997eb-f47e-4912-b41f-52e1c278ebf9 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.874146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205997eb-f47e-4912-b41f-52e1c278ebf9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.874398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205997eb-f47e-4912-b41f-52e1c278ebf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.887162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5913d3-5fc8-43b5-af15-5385369a94d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:15.888278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5913d3-5fc8-43b5-af15-5385369a94d6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:15.888278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5913d3-5fc8-43b5-af15-5385369a94d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:15.888452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5913d3-5fc8-43b5-af15-5385369a94d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:15.896587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-205997eb-f47e-4912-b41f-52e1c278ebf9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:15.897797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-205997eb-f47e-4912-b41f-52e1c278ebf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:15.935655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:15.971995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 473/972] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:15.975776 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5913d3-5fc8-43b5-af15-5385369a94d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:15.977419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5913d3-5fc8-43b5-af15-5385369a94d6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:15.980479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:16.044069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205997eb-f47e-4912-b41f-52e1c278ebf9 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.090676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 500/973] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:15 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:16.096268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5913d3-5fc8-43b5-af15-5385369a94d6 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.154280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205997eb-f47e-4912-b41f-52e1c278ebf9 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:16.191240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:16.191898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.192177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.192451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.193097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:16.194507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:16.224282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5913d3-5fc8-43b5-af15-5385369a94d6 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:16.226978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:16.238614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.sql.core [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:34:16.238614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 08:34:16.238614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [parameters: {'user_id': '8c8ded26f2a742728ff40bc17eb0ecc2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 08:34:16.238614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88128) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application result.read() Oct 04 08:34:16.246030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:34:16.250454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application yield resource Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application next(self.gen) Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.session.rollback() Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.force_reraise() Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise self.value Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application session.commit() Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 04 08:34:16.251403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._prepare_impl() Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.session.flush() Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._flush(objects) Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application compat.raise_( Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application flush_context.execute() Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rec.execute(self) Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 04 08:34:16.252387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 04 08:34:16.253953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application result = self._query(query) Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application conn.query(q) Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application result.read() Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 04 08:34:16.254799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [parameters: {'user_id': '8c8ded26f2a742728ff40bc17eb0ecc2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:16.257319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 04 08:34:16.259109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 04 08:34:16.260834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 04 08:34:16.260834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 04 08:34:16.260834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 04 08:34:16.260834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 04 08:34:16.260834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 04 08:34:16.260834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:16.260834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 474/974] 10.222.0.25 () {60 vars in 1131 bytes} [Tue Oct 4 08:34:16 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:16.260834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.268638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5921b06-52a4-432a-a3ce-5876255ae44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:16.269525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5921b06-52a4-432a-a3ce-5876255ae44f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.269914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5921b06-52a4-432a-a3ce-5876255ae44f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.270171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5921b06-52a4-432a-a3ce-5876255ae44f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.280833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5921b06-52a4-432a-a3ce-5876255ae44f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:16.282342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5921b06-52a4-432a-a3ce-5876255ae44f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:16.292314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-d5921b06-52a4-432a-a3ce-5876255ae44f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:16.297752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:16.298678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:16.301041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:16.301041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:16.301041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:16.301041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 501/975] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:16.301041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5921b06-52a4-432a-a3ce-5876255ae44f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.372197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6a623-212f-465f-9288-6f39e563c051 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:16.404130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5921b06-52a4-432a-a3ce-5876255ae44f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:16.412307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6df8a2-f087-43ce-9dc5-9e536bc1375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:16.412880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6df8a2-f087-43ce-9dc5-9e536bc1375d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.413182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6df8a2-f087-43ce-9dc5-9e536bc1375d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.413435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6df8a2-f087-43ce-9dc5-9e536bc1375d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.421793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6df8a2-f087-43ce-9dc5-9e536bc1375d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:16.423433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6df8a2-f087-43ce-9dc5-9e536bc1375d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-3c6df8a2-f087-43ce-9dc5-9e536bc1375d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:16.437300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:16.438256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 475/976] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:16 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:16.439225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6df8a2-f087-43ce-9dc5-9e536bc1375d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.440512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c63c64-b748-44dc-b9ce-dfbc5ccaab16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:16.440977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63c64-b748-44dc-b9ce-dfbc5ccaab16 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.441257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63c64-b748-44dc-b9ce-dfbc5ccaab16 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.441531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c63c64-b748-44dc-b9ce-dfbc5ccaab16 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.442195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c63c64-b748-44dc-b9ce-dfbc5ccaab16 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:16.443575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c63c64-b748-44dc-b9ce-dfbc5ccaab16 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:16.522051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 502/977] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:16 2022] POST /identity/v3/services => generated 242 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:16.523573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c63c64-b748-44dc-b9ce-dfbc5ccaab16 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.543107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:16.552267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6df8a2-f087-43ce-9dc5-9e536bc1375d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:16.560520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:16.618592 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bdb15-4c6c-473e-890e-e2457df9d028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:16.619325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bdb15-4c6c-473e-890e-e2457df9d028 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.619733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bdb15-4c6c-473e-890e-e2457df9d028 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.620097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31bdb15-4c6c-473e-890e-e2457df9d028 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.621119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bdb15-4c6c-473e-890e-e2457df9d028 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:16.621526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bdb15-4c6c-473e-890e-e2457df9d028 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:16.623365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31bdb15-4c6c-473e-890e-e2457df9d028 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:16.644054 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 476/978] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:16.645395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bdb15-4c6c-473e-890e-e2457df9d028 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.683667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c63c64-b748-44dc-b9ce-dfbc5ccaab16 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:16.727311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a890a64-890f-41a0-9c30-783ca3842406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:16.727956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a890a64-890f-41a0-9c30-783ca3842406 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.728252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a890a64-890f-41a0-9c30-783ca3842406 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.728501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a890a64-890f-41a0-9c30-783ca3842406 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.729464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a890a64-890f-41a0-9c30-783ca3842406 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:16.729464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a890a64-890f-41a0-9c30-783ca3842406 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:16.730884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a890a64-890f-41a0-9c30-783ca3842406 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:16.769162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 503/979] 10.222.0.25 () {56 vars in 1101 bytes} [Tue Oct 4 08:34:16 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:16.783064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31bdb15-4c6c-473e-890e-e2457df9d028 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:16.822159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6c8f7-0f25-462e-84a3-0776ea847dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:16.823204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6c8f7-0f25-462e-84a3-0776ea847dbd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:16.823694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6c8f7-0f25-462e-84a3-0776ea847dbd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:16.824217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6c8f7-0f25-462e-84a3-0776ea847dbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:16.832897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6c8f7-0f25-462e-84a3-0776ea847dbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:16.834679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6c8f7-0f25-462e-84a3-0776ea847dbd None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-20f6c8f7-0f25-462e-84a3-0776ea847dbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:16.847774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:16.848744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:16.849675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:16.849675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:16.849675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:16.849675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:16.849675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:16.849675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:16.849675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:16.849675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:16.852024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 477/980] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:16.858220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a890a64-890f-41a0-9c30-783ca3842406 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:16.947351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:16.974871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a890a64-890f-41a0-9c30-783ca3842406 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:17.011431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccef724d-eb26-4bde-8268-c87419812d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:17.012082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef724d-eb26-4bde-8268-c87419812d8e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:17.012362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef724d-eb26-4bde-8268-c87419812d8e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:17.012634 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccef724d-eb26-4bde-8268-c87419812d8e None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:17.013366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef724d-eb26-4bde-8268-c87419812d8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:17.013630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef724d-eb26-4bde-8268-c87419812d8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:17.015040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccef724d-eb26-4bde-8268-c87419812d8e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:17.029426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 504/981] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:17.035279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6c8f7-0f25-462e-84a3-0776ea847dbd None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:17.053574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:17.145722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6c8f7-0f25-462e-84a3-0776ea847dbd None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:17.179347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87d843-b014-48f1-8a75-3f853b31e3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:17.180280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87d843-b014-48f1-8a75-3f853b31e3d6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:17.180718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87d843-b014-48f1-8a75-3f853b31e3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:17.181172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87d843-b014-48f1-8a75-3f853b31e3d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:17.182035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87d843-b014-48f1-8a75-3f853b31e3d6 None admin] RBAC: Adding query filter params (role.id=a59bc76b7fc940959bb53b88e59e985c, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=c429ad73f92e4f6d995198189b64406b) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:17.182488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87d843-b014-48f1-8a75-3f853b31e3d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:17.184150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c87d843-b014-48f1-8a75-3f853b31e3d6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:17.191549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 478/982] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:17 2022] GET /identity/v3/role_assignments?user.id=c429ad73f92e4f6d995198189b64406b&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=a59bc76b7fc940959bb53b88e59e985c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:17.911551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec293-f34a-4b61-8d35-3445509efdc4 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:17.912043 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec293-f34a-4b61-8d35-3445509efdc4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:17.912043 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ec293-f34a-4b61-8d35-3445509efdc4 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:17.913379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 505/983] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:17.918829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873865-61cd-4209-b0c1-3530c0236d09 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:17.919231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873865-61cd-4209-b0c1-3530c0236d09 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:17.919391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96873865-61cd-4209-b0c1-3530c0236d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:17.938383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-96873865-61cd-4209-b0c1-3530c0236d09 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:17.940620 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-96873865-61cd-4209-b0c1-3530c0236d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:18.006939 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 479/984] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:17 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:18.273774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec293-f34a-4b61-8d35-3445509efdc4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:18.375941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3ec293-f34a-4b61-8d35-3445509efdc4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:18.410217 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e2740-6d2a-4ae2-b9e0-30a5b284711a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:18.410848 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e2740-6d2a-4ae2-b9e0-30a5b284711a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.411132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e2740-6d2a-4ae2-b9e0-30a5b284711a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.411405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8e2740-6d2a-4ae2-b9e0-30a5b284711a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.412019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e2740-6d2a-4ae2-b9e0-30a5b284711a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:18.413387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8e2740-6d2a-4ae2-b9e0-30a5b284711a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:18.415205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-ce8e2740-6d2a-4ae2-b9e0-30a5b284711a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:18.423037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:18.424675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:18.425545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:18.427598 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 506/985] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:18.438227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96873865-61cd-4209-b0c1-3530c0236d09 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:18.438227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:18.535386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96873865-61cd-4209-b0c1-3530c0236d09 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:18.568407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3556f9-9a5b-400e-9fc0-e63dfdead94b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:18.569132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3556f9-9a5b-400e-9fc0-e63dfdead94b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.569519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3556f9-9a5b-400e-9fc0-e63dfdead94b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.569898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3556f9-9a5b-400e-9fc0-e63dfdead94b None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.570648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3556f9-9a5b-400e-9fc0-e63dfdead94b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:18.574194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3556f9-9a5b-400e-9fc0-e63dfdead94b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:18.574194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3556f9-9a5b-400e-9fc0-e63dfdead94b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:18.583558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 480/986] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:18.586047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e2740-6d2a-4ae2-b9e0-30a5b284711a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:18.697708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8e2740-6d2a-4ae2-b9e0-30a5b284711a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:18.733012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b632710-1f59-466e-8e84-f88a2c5d9f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:18.733646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632710-1f59-466e-8e84-f88a2c5d9f61 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.733903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632710-1f59-466e-8e84-f88a2c5d9f61 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.734176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b632710-1f59-466e-8e84-f88a2c5d9f61 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.734941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632710-1f59-466e-8e84-f88a2c5d9f61 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:18.735251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632710-1f59-466e-8e84-f88a2c5d9f61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:18.736690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b632710-1f59-466e-8e84-f88a2c5d9f61 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:18.741961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 507/987] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:18.747845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3556f9-9a5b-400e-9fc0-e63dfdead94b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:18.759027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34448829-7c51-45af-84c6-67179fd42928 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.759318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34448829-7c51-45af-84c6-67179fd42928 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.759628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34448829-7c51-45af-84c6-67179fd42928 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.760935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 508/988] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:18.765821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a459e-facd-4795-a375-b8a72cbafe5d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.766101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a459e-facd-4795-a375-b8a72cbafe5d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.766370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2a459e-facd-4795-a375-b8a72cbafe5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.785176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-cf2a459e-facd-4795-a375-b8a72cbafe5d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:18.786929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cf2a459e-facd-4795-a375-b8a72cbafe5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:18.823848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:18.846637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:18.857312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 509/989] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:18.859805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3556f9-9a5b-400e-9fc0-e63dfdead94b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:18.895235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5067d51-5040-4e86-a1a6-d900ac481181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:18.895877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5067d51-5040-4e86-a1a6-d900ac481181 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:18.896159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5067d51-5040-4e86-a1a6-d900ac481181 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:18.896435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5067d51-5040-4e86-a1a6-d900ac481181 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:18.897147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5067d51-5040-4e86-a1a6-d900ac481181 None admin] RBAC: Adding query filter params (interface=admin, service_id=84fb0466b265480b93f5ebb46cb91613, region_id=RegionOne) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:18.897458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5067d51-5040-4e86-a1a6-d900ac481181 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:18.898812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5067d51-5040-4e86-a1a6-d900ac481181 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:18.909226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 481/990] 10.222.0.25 () {56 vars in 1249 bytes} [Tue Oct 4 08:34:18 2022] GET /identity/v3/endpoints?service_id=84fb0466b265480b93f5ebb46cb91613&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:18.910265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a459e-facd-4795-a375-b8a72cbafe5d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.010199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2a459e-facd-4795-a375-b8a72cbafe5d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.044141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d69b0-1497-4047-99d5-583ae7064e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.044664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d69b0-1497-4047-99d5-583ae7064e5c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.044946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d69b0-1497-4047-99d5-583ae7064e5c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.045219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d69b0-1497-4047-99d5-583ae7064e5c None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.045823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d69b0-1497-4047-99d5-583ae7064e5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.047188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d69b0-1497-4047-99d5-583ae7064e5c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.059768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 510/991] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:18 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:34:19.130053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5067d51-5040-4e86-a1a6-d900ac481181 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.239012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5067d51-5040-4e86-a1a6-d900ac481181 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.270047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.275800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71906623-1883-413f-a6be-2d6d67580aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.276458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71906623-1883-413f-a6be-2d6d67580aac None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.276734 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71906623-1883-413f-a6be-2d6d67580aac None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.277004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71906623-1883-413f-a6be-2d6d67580aac None admin] PATH_INFO: `/v3/services/compute` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.277604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71906623-1883-413f-a6be-2d6d67580aac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.279009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71906623-1883-413f-a6be-2d6d67580aac None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-71906623-1883-413f-a6be-2d6d67580aac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:19.288910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:19.289988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:19.290864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 482/992] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:19.296380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d69b0-1497-4047-99d5-583ae7064e5c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.352387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.393847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb422a-8a67-4fc4-bb3b-ec1562dd2531 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.394142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb422a-8a67-4fc4-bb3b-ec1562dd2531 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.394428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb422a-8a67-4fc4-bb3b-ec1562dd2531 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.395936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 483/993] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:19.397162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d69b0-1497-4047-99d5-583ae7064e5c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.400678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3abeaf-4968-4faa-99b0-a55b17423eeb None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.400960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3abeaf-4968-4faa-99b0-a55b17423eeb None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.401239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3abeaf-4968-4faa-99b0-a55b17423eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.419211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-0c3abeaf-4968-4faa-99b0-a55b17423eeb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:19.420565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0c3abeaf-4968-4faa-99b0-a55b17423eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:19.437486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d37d7-2ece-4ca1-9652-9636c00739e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.438095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d37d7-2ece-4ca1-9652-9636c00739e0 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.438381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d37d7-2ece-4ca1-9652-9636c00739e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.438661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3d37d7-2ece-4ca1-9652-9636c00739e0 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.439349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d37d7-2ece-4ca1-9652-9636c00739e0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:19.440177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d37d7-2ece-4ca1-9652-9636c00739e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.441542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3d37d7-2ece-4ca1-9652-9636c00739e0 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.450887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 511/994] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:19.451910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d37d7-2ece-4ca1-9652-9636c00739e0 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.497890 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 484/995] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:19.555560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3d37d7-2ece-4ca1-9652-9636c00739e0 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.579861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.598539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a09c62-e767-44d2-9c8c-79cd7aa87d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.599223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a09c62-e767-44d2-9c8c-79cd7aa87d73 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.599630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a09c62-e767-44d2-9c8c-79cd7aa87d73 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.599972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a09c62-e767-44d2-9c8c-79cd7aa87d73 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.600675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a09c62-e767-44d2-9c8c-79cd7aa87d73 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:19.601059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a09c62-e767-44d2-9c8c-79cd7aa87d73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.602475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a09c62-e767-44d2-9c8c-79cd7aa87d73 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.611975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 512/996] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:19.613884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3abeaf-4968-4faa-99b0-a55b17423eeb None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.714881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3abeaf-4968-4faa-99b0-a55b17423eeb None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.740969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:19.750006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e477d-8cb9-4f0c-bb79-46e477a40cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.751443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e477d-8cb9-4f0c-bb79-46e477a40cdd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.751443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e477d-8cb9-4f0c-bb79-46e477a40cdd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.751443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094e477d-8cb9-4f0c-bb79-46e477a40cdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.751968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e477d-8cb9-4f0c-bb79-46e477a40cdd None admin] RBAC: Adding query filter params (interface=public, service_id=c2e3c5f9372345829a8328b237599d53, region_id=RegionOne) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:19.752279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e477d-8cb9-4f0c-bb79-46e477a40cdd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.753637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094e477d-8cb9-4f0c-bb79-46e477a40cdd None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.762957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 485/997] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/endpoints?service_id=c2e3c5f9372345829a8328b237599d53&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:19.764631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a09c62-e767-44d2-9c8c-79cd7aa87d73 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.774581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e477d-8cb9-4f0c-bb79-46e477a40cdd None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:19.874555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a09c62-e767-44d2-9c8c-79cd7aa87d73 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.883044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094e477d-8cb9-4f0c-bb79-46e477a40cdd None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:19.911322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7c0f8-25a6-4fd6-8924-706a1e59f882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.911972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7c0f8-25a6-4fd6-8924-706a1e59f882 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.912298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7c0f8-25a6-4fd6-8924-706a1e59f882 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.912576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c7c0f8-25a6-4fd6-8924-706a1e59f882 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.913233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7c0f8-25a6-4fd6-8924-706a1e59f882 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.914592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c7c0f8-25a6-4fd6-8924-706a1e59f882 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.916416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb542522-640f-48a5-993b-f113c1cf9530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:19.917040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb542522-640f-48a5-993b-f113c1cf9530 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:19.917317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb542522-640f-48a5-993b-f113c1cf9530 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:19.917588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb542522-640f-48a5-993b-f113c1cf9530 None admin] PATH_INFO: `/v3/services/image` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:19.918169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb542522-640f-48a5-993b-f113c1cf9530 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:19.919491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb542522-640f-48a5-993b-f113c1cf9530 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:19.931562 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 513/998] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-cb542522-640f-48a5-993b-f113c1cf9530 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:19.940261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:19.941376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:19.943133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 486/999] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:19.948013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7c0f8-25a6-4fd6-8924-706a1e59f882 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:20.003095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:20.057746 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c7c0f8-25a6-4fd6-8924-706a1e59f882 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:20.092805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5d62ca-5f21-4e05-8d35-5e018e014340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:20.093418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d62ca-5f21-4e05-8d35-5e018e014340 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:20.093698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d62ca-5f21-4e05-8d35-5e018e014340 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:20.093974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5d62ca-5f21-4e05-8d35-5e018e014340 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:20.094606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d62ca-5f21-4e05-8d35-5e018e014340 None admin] RBAC: Adding query filter params (name=image) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:20.094917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d62ca-5f21-4e05-8d35-5e018e014340 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:20.096875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5d62ca-5f21-4e05-8d35-5e018e014340 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:20.103109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 514/1000] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:20.108639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb542522-640f-48a5-993b-f113c1cf9530 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:20.166655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:20.211993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb542522-640f-48a5-993b-f113c1cf9530 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:20.245902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0857d-4f75-4651-b429-915121f12e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:20.246569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0857d-4f75-4651-b429-915121f12e75 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:20.246846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0857d-4f75-4651-b429-915121f12e75 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:20.247118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0857d-4f75-4651-b429-915121f12e75 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:20.247880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0857d-4f75-4651-b429-915121f12e75 None admin] RBAC: Adding query filter params (type=image) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:20.248186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0857d-4f75-4651-b429-915121f12e75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:20.249525 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0857d-4f75-4651-b429-915121f12e75 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:20.259536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 487/1001] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:21.229610 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38402289-9f1f-4569-8246-dc8e6f50c567 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:21.230127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38402289-9f1f-4569-8246-dc8e6f50c567 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:21.230237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38402289-9f1f-4569-8246-dc8e6f50c567 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:21.231669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 515/1002] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:21.237348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b6d57-b363-4062-aaa9-85b182585abe None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:21.237738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b6d57-b363-4062-aaa9-85b182585abe None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:21.237898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37b6d57-b363-4062-aaa9-85b182585abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:21.255501 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b37b6d57-b363-4062-aaa9-85b182585abe None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:21.256690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b37b6d57-b363-4062-aaa9-85b182585abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:21.323020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 488/1003] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:21 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:21.593373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38402289-9f1f-4569-8246-dc8e6f50c567 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:21.695840 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38402289-9f1f-4569-8246-dc8e6f50c567 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:21.708690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:21.734499 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d0ce1-637f-40f3-8468-92bd27c7399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:21.735126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0ce1-637f-40f3-8468-92bd27c7399f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:21.735406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0ce1-637f-40f3-8468-92bd27c7399f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:21.735710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d0ce1-637f-40f3-8468-92bd27c7399f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:21.736826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d0ce1-637f-40f3-8468-92bd27c7399f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:21.738179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921d0ce1-637f-40f3-8468-92bd27c7399f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-921d0ce1-637f-40f3-8468-92bd27c7399f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:21.747623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:21.748594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:21.752983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 516/1004] 10.222.0.25 () {56 vars in 1126 bytes} [Tue Oct 4 08:34:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:21.755685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b6d57-b363-4062-aaa9-85b182585abe None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:21.807493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:21.858795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37b6d57-b363-4062-aaa9-85b182585abe None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:21.894169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208417c-402c-443b-807b-8f1f382af51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:21.894787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208417c-402c-443b-807b-8f1f382af51c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:21.895065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208417c-402c-443b-807b-8f1f382af51c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:21.895335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a208417c-402c-443b-807b-8f1f382af51c None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:21.895996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208417c-402c-443b-807b-8f1f382af51c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:21.896296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208417c-402c-443b-807b-8f1f382af51c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:21.897688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a208417c-402c-443b-807b-8f1f382af51c None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:21.907288 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 489/1005] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:21.909087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d0ce1-637f-40f3-8468-92bd27c7399f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.015703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d0ce1-637f-40f3-8468-92bd27c7399f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.049932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322bd0c-07ff-4e44-bbdd-88291d6e7521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.050540 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322bd0c-07ff-4e44-bbdd-88291d6e7521 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.050823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322bd0c-07ff-4e44-bbdd-88291d6e7521 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.051099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322bd0c-07ff-4e44-bbdd-88291d6e7521 None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.052037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322bd0c-07ff-4e44-bbdd-88291d6e7521 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:22.052342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322bd0c-07ff-4e44-bbdd-88291d6e7521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.053748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322bd0c-07ff-4e44-bbdd-88291d6e7521 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.063225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 517/1006] 10.222.0.25 () {56 vars in 1122 bytes} [Tue Oct 4 08:34:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:22.064936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208417c-402c-443b-807b-8f1f382af51c None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.086898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbee79-c7b4-4a21-bac2-7db695cc01c5 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.087214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbee79-c7b4-4a21-bac2-7db695cc01c5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.088029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbee79-c7b4-4a21-bac2-7db695cc01c5 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.089486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 518/1007] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:22.094275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc558bd2-9334-4b44-a59a-a2082d0cd501 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.094560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc558bd2-9334-4b44-a59a-a2082d0cd501 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.094852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc558bd2-9334-4b44-a59a-a2082d0cd501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.113529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-dc558bd2-9334-4b44-a59a-a2082d0cd501 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:22.114629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-dc558bd2-9334-4b44-a59a-a2082d0cd501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:22.150719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:22.172534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a208417c-402c-443b-807b-8f1f382af51c None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.187675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 519/1008] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:22 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:22.187856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:22.207668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50890ffb-0f13-42ed-9789-aeac37badaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.208278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50890ffb-0f13-42ed-9789-aeac37badaaa None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.208558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50890ffb-0f13-42ed-9789-aeac37badaaa None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.208879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50890ffb-0f13-42ed-9789-aeac37badaaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.209555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50890ffb-0f13-42ed-9789-aeac37badaaa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.210904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50890ffb-0f13-42ed-9789-aeac37badaaa None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.295554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 490/1009] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:22 2022] POST /identity/v3/endpoints => generated 325 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:22.407629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6d04-3f34-4f65-bca6-75e2c398481b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.408690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6d04-3f34-4f65-bca6-75e2c398481b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.408690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91b6d04-3f34-4f65-bca6-75e2c398481b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.410262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 520/1010] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:22.415926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62b65-bb2d-4fc5-ba38-283234b7c19f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.416260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62b65-bb2d-4fc5-ba38-283234b7c19f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.416491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f62b65-bb2d-4fc5-ba38-283234b7c19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.435852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-96f62b65-bb2d-4fc5-ba38-283234b7c19f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:22.437077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-96f62b65-bb2d-4fc5-ba38-283234b7c19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:22.457185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6d04-3f34-4f65-bca6-75e2c398481b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.515855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 491/1011] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:22 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:22.567925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91b6d04-3f34-4f65-bca6-75e2c398481b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.605906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba461c-ffd3-4755-be76-6fa38a8079a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.606538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba461c-ffd3-4755-be76-6fa38a8079a8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.606816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba461c-ffd3-4755-be76-6fa38a8079a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.607087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba461c-ffd3-4755-be76-6fa38a8079a8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.607696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba461c-ffd3-4755-be76-6fa38a8079a8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.609041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba461c-ffd3-4755-be76-6fa38a8079a8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-9cba461c-ffd3-4755-be76-6fa38a8079a8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:22.617748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:22.618743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:22.620531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 521/1012] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:22.625074 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f62b65-bb2d-4fc5-ba38-283234b7c19f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.724229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:22.727972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f62b65-bb2d-4fc5-ba38-283234b7c19f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.761193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b9af8-8680-4d24-b48e-71dcd740152b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.761801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b9af8-8680-4d24-b48e-71dcd740152b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.762078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b9af8-8680-4d24-b48e-71dcd740152b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.762348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b9af8-8680-4d24-b48e-71dcd740152b None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.762974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b9af8-8680-4d24-b48e-71dcd740152b None admin] RBAC: Adding query filter params (name=compute) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:22.763275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b9af8-8680-4d24-b48e-71dcd740152b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.764654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b9af8-8680-4d24-b48e-71dcd740152b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.769560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 492/1013] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:22.774974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba461c-ffd3-4755-be76-6fa38a8079a8 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.787500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b9af8-8680-4d24-b48e-71dcd740152b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:22.812221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:22.885370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba461c-ffd3-4755-be76-6fa38a8079a8 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.892498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b9af8-8680-4d24-b48e-71dcd740152b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:22.922214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0b552-c6b3-4935-958b-3a5afe323a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.922821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0b552-c6b3-4935-958b-3a5afe323a8c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.923097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0b552-c6b3-4935-958b-3a5afe323a8c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.923375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae0b552-c6b3-4935-958b-3a5afe323a8c None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.924659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0b552-c6b3-4935-958b-3a5afe323a8c None admin] RBAC: Adding query filter params (type=compute) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:22.924964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0b552-c6b3-4935-958b-3a5afe323a8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.926579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae0b552-c6b3-4935-958b-3a5afe323a8c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.928324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47c8c32-4121-41a9-91ec-e680cd21f11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:22.928925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c8c32-4121-41a9-91ec-e680cd21f11a None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:22.929203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c8c32-4121-41a9-91ec-e680cd21f11a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:22.929473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47c8c32-4121-41a9-91ec-e680cd21f11a None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:22.930129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c8c32-4121-41a9-91ec-e680cd21f11a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:22.931452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47c8c32-4121-41a9-91ec-e680cd21f11a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:22.931971 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 522/1014] 10.222.0.25 () {56 vars in 1112 bytes} [Tue Oct 4 08:34:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:22.937459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0b552-c6b3-4935-958b-3a5afe323a8c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:23.031622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 493/1015] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:22 2022] POST /identity/v3/services => generated 242 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:23.031838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:23.036615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae0b552-c6b3-4935-958b-3a5afe323a8c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:23.083094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330fb48-e205-48bc-b9fc-2a022d047d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:23.084037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330fb48-e205-48bc-b9fc-2a022d047d1a None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:23.084466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330fb48-e205-48bc-b9fc-2a022d047d1a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:23.084885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330fb48-e205-48bc-b9fc-2a022d047d1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:23.085756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330fb48-e205-48bc-b9fc-2a022d047d1a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:23.087391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5330fb48-e205-48bc-b9fc-2a022d047d1a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:23.172015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 523/1016] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:24.462822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b7870-d976-41fa-9454-f0793fa659e1 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.463359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b7870-d976-41fa-9454-f0793fa659e1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.463359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51b7870-d976-41fa-9454-f0793fa659e1 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.464890 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 494/1017] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:24.469892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3358f-6889-4823-b8de-d3bed68c06c7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.470273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3358f-6889-4823-b8de-d3bed68c06c7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.470484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd3358f-6889-4823-b8de-d3bed68c06c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.488204 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-6bd3358f-6889-4823-b8de-d3bed68c06c7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:24.489383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6bd3358f-6889-4823-b8de-d3bed68c06c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:24.562893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 524/1018] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:24 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:24.832653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b7870-d976-41fa-9454-f0793fa659e1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:24.857329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:24.937599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51b7870-d976-41fa-9454-f0793fa659e1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:24.972925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b255cfa-9fa6-4d1b-85c5-531b8ecf83b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:24.973783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b255cfa-9fa6-4d1b-85c5-531b8ecf83b9 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:24.974205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b255cfa-9fa6-4d1b-85c5-531b8ecf83b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:24.974652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b255cfa-9fa6-4d1b-85c5-531b8ecf83b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:24.975918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b255cfa-9fa6-4d1b-85c5-531b8ecf83b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:24.977499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b255cfa-9fa6-4d1b-85c5-531b8ecf83b9 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:24.979198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 495/1019] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:24.985187 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3358f-6889-4823-b8de-d3bed68c06c7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.062093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:25.083749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd3358f-6889-4823-b8de-d3bed68c06c7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:25.122538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c37fab1-9d94-4f07-bf46-20395ef2052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:25.123609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37fab1-9d94-4f07-bf46-20395ef2052f None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.124093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37fab1-9d94-4f07-bf46-20395ef2052f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.124588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c37fab1-9d94-4f07-bf46-20395ef2052f None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.125469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37fab1-9d94-4f07-bf46-20395ef2052f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:25.131622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c37fab1-9d94-4f07-bf46-20395ef2052f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:25.221325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e85c4-8de8-4298-9aae-4e99aa4fed8e None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.221600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e85c4-8de8-4298-9aae-4e99aa4fed8e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.221869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e85c4-8de8-4298-9aae-4e99aa4fed8e None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.223205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 496/1020] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:25.228201 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5f257-97a3-4e50-905a-d769a847b20a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.228482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5f257-97a3-4e50-905a-d769a847b20a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.228755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5f257-97a3-4e50-905a-d769a847b20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.246064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 525/1021] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:24 2022] POST /identity/v3/projects => generated 311 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:25.252831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bdc5f257-97a3-4e50-905a-d769a847b20a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:25.254130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bdc5f257-97a3-4e50-905a-d769a847b20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:25.332332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 497/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:25.452691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907e1a-2322-412a-a966-0198d914bd22 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.453094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907e1a-2322-412a-a966-0198d914bd22 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.453440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77907e1a-2322-412a-a966-0198d914bd22 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.455356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 526/1023] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:25.460807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b076-a4e8-442c-bff9-e4c85be369fb None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.461325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b076-a4e8-442c-bff9-e4c85be369fb None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.461801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b076-a4e8-442c-bff9-e4c85be369fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.481258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-4173b076-a4e8-442c-bff9-e4c85be369fb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:25.482444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4173b076-a4e8-442c-bff9-e4c85be369fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:25.497377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:25.551106 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 498/1024] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:25.608741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77907e1a-2322-412a-a966-0198d914bd22 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.710668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77907e1a-2322-412a-a966-0198d914bd22 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:25.736072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:25.744649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ccd7-283c-4332-b072-cc62607a89ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:25.745273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ccd7-283c-4332-b072-cc62607a89ad None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.745549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ccd7-283c-4332-b072-cc62607a89ad None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.745888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6ccd7-283c-4332-b072-cc62607a89ad None admin] PATH_INFO: `/v3/services/image` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.746437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6ccd7-283c-4332-b072-cc62607a89ad None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:25.747859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6ccd7-283c-4332-b072-cc62607a89ad None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-71d6ccd7-283c-4332-b072-cc62607a89ad None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:25.757196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:25.758181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:25.759031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:25.763190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 527/1025] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Oct 4 08:34:25 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:25.768139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b076-a4e8-442c-bff9-e4c85be369fb None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.821823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ccd7-283c-4332-b072-cc62607a89ad None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.870623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b076-a4e8-442c-bff9-e4c85be369fb None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:25.911406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3049c-2b4a-4f46-9fe7-6b555212306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:25.912014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3049c-2b4a-4f46-9fe7-6b555212306a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.912291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3049c-2b4a-4f46-9fe7-6b555212306a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.912584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d3049c-2b4a-4f46-9fe7-6b555212306a None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.913987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3049c-2b4a-4f46-9fe7-6b555212306a None admin] RBAC: Adding query filter params (name=image) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:25.913987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3049c-2b4a-4f46-9fe7-6b555212306a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:25.914997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d3049c-2b4a-4f46-9fe7-6b555212306a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:25.920298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 499/1026] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:25.925988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3049c-2b4a-4f46-9fe7-6b555212306a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:25.937039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6ccd7-283c-4332-b072-cc62607a89ad None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:25.944002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:25.977012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e892-b267-4ddf-8ab7-cbc31be8bd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:25.978153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e892-b267-4ddf-8ab7-cbc31be8bd87 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:25.978612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e892-b267-4ddf-8ab7-cbc31be8bd87 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:25.979271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f624e892-b267-4ddf-8ab7-cbc31be8bd87 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:25.990513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f624e892-b267-4ddf-8ab7-cbc31be8bd87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-f624e892-b267-4ddf-8ab7-cbc31be8bd87 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:25.995255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:25.996218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:25.997078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 528/1027] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:26.002734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e892-b267-4ddf-8ab7-cbc31be8bd87 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.034283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d3049c-2b4a-4f46-9fe7-6b555212306a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.065485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:26.074219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf140-967a-486f-8bf6-cb1a7554ad55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.075397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf140-967a-486f-8bf6-cb1a7554ad55 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.075716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf140-967a-486f-8bf6-cb1a7554ad55 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.082125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcbf140-967a-486f-8bf6-cb1a7554ad55 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.082125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf140-967a-486f-8bf6-cb1a7554ad55 None admin] RBAC: Adding query filter params (type=image) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:26.082125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf140-967a-486f-8bf6-cb1a7554ad55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.082125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcbf140-967a-486f-8bf6-cb1a7554ad55 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.090002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 500/1028] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:26.090994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf140-967a-486f-8bf6-cb1a7554ad55 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.113381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f624e892-b267-4ddf-8ab7-cbc31be8bd87 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.149129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3685ff1-6443-4f48-893d-f1f26bc37626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.149739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3685ff1-6443-4f48-893d-f1f26bc37626 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.150021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3685ff1-6443-4f48-893d-f1f26bc37626 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.150296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3685ff1-6443-4f48-893d-f1f26bc37626 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.150954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3685ff1-6443-4f48-893d-f1f26bc37626 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:26.151263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3685ff1-6443-4f48-893d-f1f26bc37626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.152680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3685ff1-6443-4f48-893d-f1f26bc37626 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.163550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 529/1029] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:26.166623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3685ff1-6443-4f48-893d-f1f26bc37626 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.174663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:26.198622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcbf140-967a-486f-8bf6-cb1a7554ad55 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.242692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0336-a04b-4e73-950e-e57b6d3803f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.243984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0336-a04b-4e73-950e-e57b6d3803f8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.244281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0336-a04b-4e73-950e-e57b6d3803f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.244555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0336-a04b-4e73-950e-e57b6d3803f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.245256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0336-a04b-4e73-950e-e57b6d3803f8 None admin] RBAC: Adding query filter params (interface=public, service_id=d02e93ac24464a2f8bba01143c09fe56, region_id=RegionOne) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:26.245564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0336-a04b-4e73-950e-e57b6d3803f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.246927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0336-a04b-4e73-950e-e57b6d3803f8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.253401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 501/1030] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 08:34:26 2022] GET /identity/v3/endpoints?service_id=d02e93ac24464a2f8bba01143c09fe56&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:26.258906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0336-a04b-4e73-950e-e57b6d3803f8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.279177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3685ff1-6443-4f48-893d-f1f26bc37626 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.294754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:26.316906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4bee-56e3-41e8-a769-294c36ee3c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.317646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4bee-56e3-41e8-a769-294c36ee3c36 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.317927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4bee-56e3-41e8-a769-294c36ee3c36 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.318340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d4bee-56e3-41e8-a769-294c36ee3c36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.329642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d4bee-56e3-41e8-a769-294c36ee3c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.331125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d4bee-56e3-41e8-a769-294c36ee3c36 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-019d4bee-56e3-41e8-a769-294c36ee3c36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:26.345664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:26.346623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:26.347604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:26.347604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:26.347604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:26.347604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 530/1031] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:26.352696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4bee-56e3-41e8-a769-294c36ee3c36 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.369242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0336-a04b-4e73-950e-e57b6d3803f8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.403231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940c5b3-90b6-4d93-aadc-4237b0c3264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.403867 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940c5b3-90b6-4d93-aadc-4237b0c3264e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.404140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940c5b3-90b6-4d93-aadc-4237b0c3264e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.404408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940c5b3-90b6-4d93-aadc-4237b0c3264e None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.405033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940c5b3-90b6-4d93-aadc-4237b0c3264e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.406350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940c5b3-90b6-4d93-aadc-4237b0c3264e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.419599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 502/1032] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 08:34:26 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:34:26.459990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d4bee-56e3-41e8-a769-294c36ee3c36 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.497978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65148472-1dee-4f71-9979-4f9c7acfd82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.498512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65148472-1dee-4f71-9979-4f9c7acfd82b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.498788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65148472-1dee-4f71-9979-4f9c7acfd82b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.499060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65148472-1dee-4f71-9979-4f9c7acfd82b None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.499743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65148472-1dee-4f71-9979-4f9c7acfd82b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:26.500047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65148472-1dee-4f71-9979-4f9c7acfd82b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.501431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65148472-1dee-4f71-9979-4f9c7acfd82b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.514764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 531/1033] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:26.520791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940c5b3-90b6-4d93-aadc-4237b0c3264e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.530446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:26.637992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940c5b3-90b6-4d93-aadc-4237b0c3264e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.672043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bcb49-c767-4512-a8df-824c94eadcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.672918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bcb49-c767-4512-a8df-824c94eadcb3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.673348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bcb49-c767-4512-a8df-824c94eadcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.674312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51bcb49-c767-4512-a8df-824c94eadcb3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.682243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bcb49-c767-4512-a8df-824c94eadcb3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.683940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51bcb49-c767-4512-a8df-824c94eadcb3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-b51bcb49-c767-4512-a8df-824c94eadcb3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:26.695155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:26.696239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:26.697231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 503/1034] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 08:34:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:26.703933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65148472-1dee-4f71-9979-4f9c7acfd82b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.732482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:26.806544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65148472-1dee-4f71-9979-4f9c7acfd82b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:26.841650 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24ecd0-2eb6-4f19-bbc2-8aafafcf9979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:26.842345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24ecd0-2eb6-4f19-bbc2-8aafafcf9979 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:26.842691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24ecd0-2eb6-4f19-bbc2-8aafafcf9979 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:26.843032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d24ecd0-2eb6-4f19-bbc2-8aafafcf9979 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:26.843862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24ecd0-2eb6-4f19-bbc2-8aafafcf9979 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:26.844235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24ecd0-2eb6-4f19-bbc2-8aafafcf9979 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:26.846344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d24ecd0-2eb6-4f19-bbc2-8aafafcf9979 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:26.868239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 532/1035] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 08:34:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:26.869454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bcb49-c767-4512-a8df-824c94eadcb3 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:26.937641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:26.972387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51bcb49-c767-4512-a8df-824c94eadcb3 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:27.005540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573e078-e4ca-4f20-91ca-ff81945df051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:27.006145 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573e078-e4ca-4f20-91ca-ff81945df051 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.006421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573e078-e4ca-4f20-91ca-ff81945df051 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.006691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5573e078-e4ca-4f20-91ca-ff81945df051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.073445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573e078-e4ca-4f20-91ca-ff81945df051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:27.074790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5573e078-e4ca-4f20-91ca-ff81945df051 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:27.137322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:27.177795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 504/1036] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:26 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:34:27.179051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24ecd0-2eb6-4f19-bbc2-8aafafcf9979 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:27.263008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:27.278892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d24ecd0-2eb6-4f19-bbc2-8aafafcf9979 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:27.314085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a57003-4afb-461d-beee-1574192538e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:27.315266 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a57003-4afb-461d-beee-1574192538e2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.315572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a57003-4afb-461d-beee-1574192538e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.315851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a57003-4afb-461d-beee-1574192538e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.326391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a57003-4afb-461d-beee-1574192538e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:27.327811 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a57003-4afb-461d-beee-1574192538e2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-11a57003-4afb-461d-beee-1574192538e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:27.342525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:27.343457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:27.345016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:27.345016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:27.345016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:27.345016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 533/1037] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:27.349965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573e078-e4ca-4f20-91ca-ff81945df051 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:27.450762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5573e078-e4ca-4f20-91ca-ff81945df051 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:27.480915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909730f0-498c-4d3c-9573-725d96dce62b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.481202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909730f0-498c-4d3c-9573-725d96dce62b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.481477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909730f0-498c-4d3c-9573-725d96dce62b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.482937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 534/1038] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:27.485488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af08b69-bd36-475e-996a-0c56d1e3a5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:27.486225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af08b69-bd36-475e-996a-0c56d1e3a5a3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.486649 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af08b69-bd36-475e-996a-0c56d1e3a5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.487046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af08b69-bd36-475e-996a-0c56d1e3a5a3 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.487648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df42f-09d7-4e48-8eb9-b9ca21df51e9 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.487917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af08b69-bd36-475e-996a-0c56d1e3a5a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:27.488009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df42f-09d7-4e48-8eb9-b9ca21df51e9 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.488194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9df42f-09d7-4e48-8eb9-b9ca21df51e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.488480 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af08b69-bd36-475e-996a-0c56d1e3a5a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:27.489931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af08b69-bd36-475e-996a-0c56d1e3a5a3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:27.506131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 505/1039] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:27.507131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af08b69-bd36-475e-996a-0c56d1e3a5a3 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:27.507246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-7b9df42f-09d7-4e48-8eb9-b9ca21df51e9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:27.508486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7b9df42f-09d7-4e48-8eb9-b9ca21df51e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:27.534678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:27.580974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 535/1040] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:27 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:27.616114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af08b69-bd36-475e-996a-0c56d1e3a5a3 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:27.650007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d16c-86b9-4976-873f-f2f88e60eb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:27.650775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d16c-86b9-4976-873f-f2f88e60eb31 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.651153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d16c-86b9-4976-873f-f2f88e60eb31 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.651544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c72d16c-86b9-4976-873f-f2f88e60eb31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.658324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72d16c-86b9-4976-873f-f2f88e60eb31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:27.659883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c72d16c-86b9-4976-873f-f2f88e60eb31 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-3c72d16c-86b9-4976-873f-f2f88e60eb31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:27.670978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:27.672063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:27.673217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:27.673217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:27.673217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:27.673217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:27.673217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:27.673217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:27.673217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:27.673217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:27.680250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 506/1041] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:27.681292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9df42f-09d7-4e48-8eb9-b9ca21df51e9 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:27.744914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:27.779113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9df42f-09d7-4e48-8eb9-b9ca21df51e9 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:27.812787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fce0d-bb74-4457-a68a-398332ebc122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:27.813529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fce0d-bb74-4457-a68a-398332ebc122 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.813907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fce0d-bb74-4457-a68a-398332ebc122 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.814829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342fce0d-bb74-4457-a68a-398332ebc122 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.815640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fce0d-bb74-4457-a68a-398332ebc122 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:27.816039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fce0d-bb74-4457-a68a-398332ebc122 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:27.817555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342fce0d-bb74-4457-a68a-398332ebc122 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:27.829366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 536/1042] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:27.835306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d16c-86b9-4976-873f-f2f88e60eb31 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:27.853952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fce0d-bb74-4457-a68a-398332ebc122 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:27.931133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:27.947500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c72d16c-86b9-4976-873f-f2f88e60eb31 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:27.959401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342fce0d-bb74-4457-a68a-398332ebc122 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:27.983635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b090-02e1-4788-8bc3-4bdfb0a9c5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:27.984248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b090-02e1-4788-8bc3-4bdfb0a9c5ae None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.984523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b090-02e1-4788-8bc3-4bdfb0a9c5ae None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.984794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86b090-02e1-4788-8bc3-4bdfb0a9c5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.985520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b090-02e1-4788-8bc3-4bdfb0a9c5ae None admin] RBAC: Adding query filter params (role.id=a59bc76b7fc940959bb53b88e59e985c, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=e05901861bc34c2398ec600150296657) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:27.985827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b090-02e1-4788-8bc3-4bdfb0a9c5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:27.987217 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:27.988049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86b090-02e1-4788-8bc3-4bdfb0a9c5ae None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:27.996356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96edf559-0283-4031-9c87-a78d91a88d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:27.996986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edf559-0283-4031-9c87-a78d91a88d22 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:27.997266 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edf559-0283-4031-9c87-a78d91a88d22 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:27.997537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96edf559-0283-4031-9c87-a78d91a88d22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:27.998719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edf559-0283-4031-9c87-a78d91a88d22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:28.000350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96edf559-0283-4031-9c87-a78d91a88d22 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:28.007402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 507/1043] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:27 2022] GET /identity/v3/role_assignments?user.id=e05901861bc34c2398ec600150296657&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=a59bc76b7fc940959bb53b88e59e985c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:28.007611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 537/1044] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:28.007871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b090-02e1-4788-8bc3-4bdfb0a9c5ae None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:28.119692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86b090-02e1-4788-8bc3-4bdfb0a9c5ae None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:28.154678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911bf65c-87cc-4d8f-b348-5fc700b0bd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:28.155300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bf65c-87cc-4d8f-b348-5fc700b0bd45 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.155613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bf65c-87cc-4d8f-b348-5fc700b0bd45 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.155889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911bf65c-87cc-4d8f-b348-5fc700b0bd45 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.156564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bf65c-87cc-4d8f-b348-5fc700b0bd45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:28.158526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911bf65c-87cc-4d8f-b348-5fc700b0bd45 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:28.269584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 508/1045] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:34:28 2022] POST /identity/v3/users => generated 285 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:28.605329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c628-5b10-4242-86d7-e7853622c9c4 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.605617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c628-5b10-4242-86d7-e7853622c9c4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.605955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5c628-5b10-4242-86d7-e7853622c9c4 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.607323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 538/1046] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:28.613134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a876-2673-4999-9767-0efdb907d5d9 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:28.613554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a876-2673-4999-9767-0efdb907d5d9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:28.613736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f894a876-2673-4999-9767-0efdb907d5d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:28.626604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:28.632710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f894a876-2673-4999-9767-0efdb907d5d9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:28.633888 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f894a876-2673-4999-9767-0efdb907d5d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:28.701538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 509/1047] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:28 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:28.971211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5c628-5b10-4242-86d7-e7853622c9c4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.074429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5c628-5b10-4242-86d7-e7853622c9c4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.107024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf714af-6e93-436e-89ae-b30eeef789a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.107679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf714af-6e93-436e-89ae-b30eeef789a2 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.107958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf714af-6e93-436e-89ae-b30eeef789a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.108226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf714af-6e93-436e-89ae-b30eeef789a2 None admin] PATH_INFO: `/v3/services/image` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.108803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf714af-6e93-436e-89ae-b30eeef789a2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.110301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf714af-6e93-436e-89ae-b30eeef789a2 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-1bf714af-6e93-436e-89ae-b30eeef789a2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:29.119459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:29.120608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:29.121536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 539/1048] 10.222.0.25 () {56 vars in 1105 bytes} [Tue Oct 4 08:34:28 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:29.126553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a876-2673-4999-9767-0efdb907d5d9 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.225767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f894a876-2673-4999-9767-0efdb907d5d9 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.259548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dcf13-8c32-492a-b56a-78f7f38a9eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.260154 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dcf13-8c32-492a-b56a-78f7f38a9eba None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.260428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dcf13-8c32-492a-b56a-78f7f38a9eba None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.260693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878dcf13-8c32-492a-b56a-78f7f38a9eba None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.261313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dcf13-8c32-492a-b56a-78f7f38a9eba None admin] RBAC: Adding query filter params (name=image) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:29.261610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dcf13-8c32-492a-b56a-78f7f38a9eba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.262956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878dcf13-8c32-492a-b56a-78f7f38a9eba None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.264875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:29.269012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 510/1049] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:29.274887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf714af-6e93-436e-89ae-b30eeef789a2 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.333729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:29.374928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf714af-6e93-436e-89ae-b30eeef789a2 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.407789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a04503-7c1c-4755-80e3-380b5927d61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.409214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04503-7c1c-4755-80e3-380b5927d61d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.409492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04503-7c1c-4755-80e3-380b5927d61d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.409761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04503-7c1c-4755-80e3-380b5927d61d None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.410382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a04503-7c1c-4755-80e3-380b5927d61d None admin] RBAC: Adding query filter params (type=image) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:29.410680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a04503-7c1c-4755-80e3-380b5927d61d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.412127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a04503-7c1c-4755-80e3-380b5927d61d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.417175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 540/1050] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:29 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:29.422764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dcf13-8c32-492a-b56a-78f7f38a9eba None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:29.521073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878dcf13-8c32-492a-b56a-78f7f38a9eba None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:29.554701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3d41-75a6-42d7-9cfe-a20a5f0cb9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:29.555308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3d41-75a6-42d7-9cfe-a20a5f0cb9a2 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:29.555670 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3d41-75a6-42d7-9cfe-a20a5f0cb9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:29.555877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3d41-75a6-42d7-9cfe-a20a5f0cb9a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:29.556550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3d41-75a6-42d7-9cfe-a20a5f0cb9a2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:29.557895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3d41-75a6-42d7-9cfe-a20a5f0cb9a2 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:29.684287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 511/1051] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:34:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:30.172046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039647d-d432-46b6-bf4e-736e98718dda None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.172568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039647d-d432-46b6-bf4e-736e98718dda None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.172669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e039647d-d432-46b6-bf4e-736e98718dda None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.174667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 541/1052] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:30.179837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ff880-523e-443e-9da5-ccbddf64b903 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.180132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ff880-523e-443e-9da5-ccbddf64b903 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.180412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ff880-523e-443e-9da5-ccbddf64b903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.198484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9f5ff880-523e-443e-9da5-ccbddf64b903 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:30.199700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9f5ff880-523e-443e-9da5-ccbddf64b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:30.251265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:30.273227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 512/1053] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:30.477974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e8b46-b2c4-4705-b3f5-e0f3e48b35f3 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.478360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e8b46-b2c4-4705-b3f5-e0f3e48b35f3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.478537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2e8b46-b2c4-4705-b3f5-e0f3e48b35f3 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.480029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 542/1054] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:30.484987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a037b0-31ad-4335-8187-cdc07111c564 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.485278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a037b0-31ad-4335-8187-cdc07111c564 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.485553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a037b0-31ad-4335-8187-cdc07111c564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.504034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-90a037b0-31ad-4335-8187-cdc07111c564 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:30.505211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-90a037b0-31ad-4335-8187-cdc07111c564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:30.544530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e8b46-b2c4-4705-b3f5-e0f3e48b35f3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.575687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 513/1055] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:30.654418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2e8b46-b2c4-4705-b3f5-e0f3e48b35f3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.676788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:30.688014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f3027-1dfa-4f05-adc0-1afd4931c8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:30.698714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f3027-1dfa-4f05-adc0-1afd4931c8c5 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.698714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f3027-1dfa-4f05-adc0-1afd4931c8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.698714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f3027-1dfa-4f05-adc0-1afd4931c8c5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.699061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f3027-1dfa-4f05-adc0-1afd4931c8c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-6d7f3027-1dfa-4f05-adc0-1afd4931c8c5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:30.703904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:30.705376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:30.706259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:30.710624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 543/1056] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:30.711878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a037b0-31ad-4335-8187-cdc07111c564 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.813601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a037b0-31ad-4335-8187-cdc07111c564 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.826972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:30.847650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaf70e-8c2d-43b9-a0a0-a369f3234360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:30.848252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaf70e-8c2d-43b9-a0a0-a369f3234360 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.848532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaf70e-8c2d-43b9-a0a0-a369f3234360 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.848806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beaf70e-8c2d-43b9-a0a0-a369f3234360 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:30.849472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaf70e-8c2d-43b9-a0a0-a369f3234360 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:30.850045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaf70e-8c2d-43b9-a0a0-a369f3234360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:30.851019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f3027-1dfa-4f05-adc0-1afd4931c8c5 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.851185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beaf70e-8c2d-43b9-a0a0-a369f3234360 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:30.867543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 514/1057] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:30.868810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaf70e-8c2d-43b9-a0a0-a369f3234360 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:30.959013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f3027-1dfa-4f05-adc0-1afd4931c8c5 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.974756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beaf70e-8c2d-43b9-a0a0-a369f3234360 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:30.993738 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a950f-d5ee-46b0-a914-cdef76d12fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:30.994368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a950f-d5ee-46b0-a914-cdef76d12fe4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:30.994649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a950f-d5ee-46b0-a914-cdef76d12fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:30.994917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71a950f-d5ee-46b0-a914-cdef76d12fe4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.005019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71a950f-d5ee-46b0-a914-cdef76d12fe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:31.009755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806652-7e24-42d0-a337-ded9e2474b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-f71a950f-d5ee-46b0-a914-cdef76d12fe4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:31.009885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:31.010788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:31.012124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:31.012788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806652-7e24-42d0-a337-ded9e2474b0e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.012788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806652-7e24-42d0-a337-ded9e2474b0e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.012788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b806652-7e24-42d0-a337-ded9e2474b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.012966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 544/1058] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:31.016743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a950f-d5ee-46b0-a914-cdef76d12fe4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.027594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b806652-7e24-42d0-a337-ded9e2474b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.029477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b806652-7e24-42d0-a337-ded9e2474b0e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-3b806652-7e24-42d0-a337-ded9e2474b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:31.045519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:31.046503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:31.047444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:31.047444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:31.047444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:31.052724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 515/1059] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:31.053464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806652-7e24-42d0-a337-ded9e2474b0e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.066181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.082070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.123667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71a950f-d5ee-46b0-a914-cdef76d12fe4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.158424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b806652-7e24-42d0-a337-ded9e2474b0e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.158622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293f331-4b63-416f-a83e-5fdfd9370e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.159142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293f331-4b63-416f-a83e-5fdfd9370e1c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.159417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293f331-4b63-416f-a83e-5fdfd9370e1c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.159711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7293f331-4b63-416f-a83e-5fdfd9370e1c None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.160528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293f331-4b63-416f-a83e-5fdfd9370e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:31.160833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293f331-4b63-416f-a83e-5fdfd9370e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.162185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7293f331-4b63-416f-a83e-5fdfd9370e1c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.169873 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 545/1060] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:31.176293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293f331-4b63-416f-a83e-5fdfd9370e1c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.199668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f156b-eb7f-47c3-928d-07163f27da57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.200703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f156b-eb7f-47c3-928d-07163f27da57 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.201277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f156b-eb7f-47c3-928d-07163f27da57 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.201745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7f156b-eb7f-47c3-928d-07163f27da57 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.202590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f156b-eb7f-47c3-928d-07163f27da57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:31.203317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f156b-eb7f-47c3-928d-07163f27da57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.205635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7f156b-eb7f-47c3-928d-07163f27da57 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.218923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 516/1061] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:31.225189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f156b-eb7f-47c3-928d-07163f27da57 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.277330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7293f331-4b63-416f-a83e-5fdfd9370e1c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.280709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.311847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f07f97-e238-4842-9f4c-ac70f517e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.312471 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f07f97-e238-4842-9f4c-ac70f517e18f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.312752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f07f97-e238-4842-9f4c-ac70f517e18f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.313034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f07f97-e238-4842-9f4c-ac70f517e18f None admin] PATH_INFO: `/v3/users/6d77be9638f64dfe8a41a9a7d2410cf8` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.317712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.327796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f07f97-e238-4842-9f4c-ac70f517e18f None admin] RBAC: Authorizing `identity:get_user(user_id=6d77be9638f64dfe8a41a9a7d2410cf8)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.329255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f07f97-e238-4842-9f4c-ac70f517e18f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.332812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7f156b-eb7f-47c3-928d-07163f27da57 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.336527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 546/1062] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/users/6d77be9638f64dfe8a41a9a7d2410cf8 => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:31.337369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f07f97-e238-4842-9f4c-ac70f517e18f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.367880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c872a-94a4-450b-b01e-5c0f760cc6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.368514 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c872a-94a4-450b-b01e-5c0f760cc6d5 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.368795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c872a-94a4-450b-b01e-5c0f760cc6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.369073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61c872a-94a4-450b-b01e-5c0f760cc6d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.376116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c872a-94a4-450b-b01e-5c0f760cc6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.377845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61c872a-94a4-450b-b01e-5c0f760cc6d5 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-e61c872a-94a4-450b-b01e-5c0f760cc6d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:31.394280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:31.395270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:31.396420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 517/1063] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:31.401157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c872a-94a4-450b-b01e-5c0f760cc6d5 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.442612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f07f97-e238-4842-9f4c-ac70f517e18f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.478953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375db55-9ce9-4e40-8725-b982ba35b687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.479675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375db55-9ce9-4e40-8725-b982ba35b687 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.479878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375db55-9ce9-4e40-8725-b982ba35b687 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.480159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2375db55-9ce9-4e40-8725-b982ba35b687 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.508285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61c872a-94a4-450b-b01e-5c0f760cc6d5 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.512086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.547108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872cc62-6e8a-497b-a66f-ff8266648c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.548093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872cc62-6e8a-497b-a66f-ff8266648c5a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.548764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872cc62-6e8a-497b-a66f-ff8266648c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.549268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a872cc62-6e8a-497b-a66f-ff8266648c5a None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.550941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872cc62-6e8a-497b-a66f-ff8266648c5a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:31.551806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872cc62-6e8a-497b-a66f-ff8266648c5a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.552139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375db55-9ce9-4e40-8725-b982ba35b687 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.553589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2375db55-9ce9-4e40-8725-b982ba35b687 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.553700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a872cc62-6e8a-497b-a66f-ff8266648c5a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.577355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 518/1064] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:31.578416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872cc62-6e8a-497b-a66f-ff8266648c5a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.583878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.657263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 547/1065] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:31.664480 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375db55-9ce9-4e40-8725-b982ba35b687 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.703094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a872cc62-6e8a-497b-a66f-ff8266648c5a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.728199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.740535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a25cee-19e6-4e57-aa9f-10d784e47fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.741171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a25cee-19e6-4e57-aa9f-10d784e47fc0 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.741449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a25cee-19e6-4e57-aa9f-10d784e47fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.743642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a25cee-19e6-4e57-aa9f-10d784e47fc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.753238 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a25cee-19e6-4e57-aa9f-10d784e47fc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.754731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a25cee-19e6-4e57-aa9f-10d784e47fc0 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.770305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2375db55-9ce9-4e40-8725-b982ba35b687 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-f3a25cee-19e6-4e57-aa9f-10d784e47fc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:31.771660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:31.772664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:31.773576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:31.773576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:31.773576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:31.774353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 519/1066] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:31.780162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a25cee-19e6-4e57-aa9f-10d784e47fc0 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.815872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc59671-40f2-4501-8edd-7e25aebe6c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.816554 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc59671-40f2-4501-8edd-7e25aebe6c5a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.816842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc59671-40f2-4501-8edd-7e25aebe6c5a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.817124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc59671-40f2-4501-8edd-7e25aebe6c5a None admin] PATH_INFO: `/v3/projects/256abbcb7468431abcb65117baee1d5f` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.819430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc59671-40f2-4501-8edd-7e25aebe6c5a None admin] RBAC: Authorizing `identity:get_project(project_id=256abbcb7468431abcb65117baee1d5f)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.820939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc59671-40f2-4501-8edd-7e25aebe6c5a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.827420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 548/1067] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/projects/256abbcb7468431abcb65117baee1d5f => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:31.828830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc59671-40f2-4501-8edd-7e25aebe6c5a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.840181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.887494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a25cee-19e6-4e57-aa9f-10d784e47fc0 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.919914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4dfeba-d10a-4d00-a3a0-133879bcf616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.920516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dfeba-d10a-4d00-a3a0-133879bcf616 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.920792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dfeba-d10a-4d00-a3a0-133879bcf616 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.921071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4dfeba-d10a-4d00-a3a0-133879bcf616 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.921707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dfeba-d10a-4d00-a3a0-133879bcf616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:31.922008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dfeba-d10a-4d00-a3a0-133879bcf616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.923348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4dfeba-d10a-4d00-a3a0-133879bcf616 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.934854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc59671-40f2-4501-8edd-7e25aebe6c5a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:31.935559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 520/1068] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:31.936701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9596-6ede-4940-b38e-6d1021d73144 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.936981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9596-6ede-4940-b38e-6d1021d73144 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.937251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2a9596-6ede-4940-b38e-6d1021d73144 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.938434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 521/1069] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:31.941136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a9596-6ede-4940-b38e-6d1021d73144 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:31.966298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:31.972533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa3e270-35b8-45de-8c78-ffbfc153f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:31.973129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e270-35b8-45de-8c78-ffbfc153f203 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.973406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e270-35b8-45de-8c78-ffbfc153f203 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.973682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa3e270-35b8-45de-8c78-ffbfc153f203 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:31.974390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3e270-35b8-45de-8c78-ffbfc153f203 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=256abbcb7468431abcb65117baee1d5f, user.id=6d77be9638f64dfe8a41a9a7d2410cf8) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:31.974696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3e270-35b8-45de-8c78-ffbfc153f203 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:31.976195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa3e270-35b8-45de-8c78-ffbfc153f203 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:31.984040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 549/1070] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/role_assignments?user.id=6d77be9638f64dfe8a41a9a7d2410cf8&scope.project.id=256abbcb7468431abcb65117baee1d5f&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:31.984040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7af50-d4c0-4d8d-9ea5-f7b83f53610b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:31.984040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7af50-d4c0-4d8d-9ea5-f7b83f53610b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:31.984040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af7af50-d4c0-4d8d-9ea5-f7b83f53610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:32.014235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-2af7af50-d4c0-4d8d-9ea5-f7b83f53610b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:32.015457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2af7af50-d4c0-4d8d-9ea5-f7b83f53610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:32.053507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2a9596-6ede-4940-b38e-6d1021d73144 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:32.071935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:32.091872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e506522-5618-4a99-9458-e609e15a60e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:32.092368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e506522-5618-4a99-9458-e609e15a60e2 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:32.092667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e506522-5618-4a99-9458-e609e15a60e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:32.092921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e506522-5618-4a99-9458-e609e15a60e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:32.098422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 550/1071] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:32.100775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e506522-5618-4a99-9458-e609e15a60e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:32.102242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e506522-5618-4a99-9458-e609e15a60e2 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-3e506522-5618-4a99-9458-e609e15a60e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:32.115037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:32.116261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:32.117528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:32.117528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:32.117528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:32.117528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:32.117528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:32.117528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:32.117528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:32.117528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:32.119679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 522/1072] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:32.122262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7af50-d4c0-4d8d-9ea5-f7b83f53610b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:32.228702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af7af50-d4c0-4d8d-9ea5-f7b83f53610b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:32.251782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:32.263101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655bd87-732e-4726-863f-c25b693eb985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:32.267782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655bd87-732e-4726-863f-c25b693eb985 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:32.267782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655bd87-732e-4726-863f-c25b693eb985 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:32.267782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655bd87-732e-4726-863f-c25b693eb985 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:32.267782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655bd87-732e-4726-863f-c25b693eb985 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:32.267782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655bd87-732e-4726-863f-c25b693eb985 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:32.267782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1655bd87-732e-4726-863f-c25b693eb985 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:32.283613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 551/1073] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:32.285397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e506522-5618-4a99-9458-e609e15a60e2 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:32.364548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655bd87-732e-4726-863f-c25b693eb985 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:32.388446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e506522-5618-4a99-9458-e609e15a60e2 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:32.424284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d0de3-64d3-45cf-bf2d-9620b1435bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:32.424957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d0de3-64d3-45cf-bf2d-9620b1435bfa None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:32.425244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d0de3-64d3-45cf-bf2d-9620b1435bfa None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:32.425527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d0de3-64d3-45cf-bf2d-9620b1435bfa None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/e05901861bc34c2398ec600150296657/roles/a59bc76b7fc940959bb53b88e59e985c` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:32.427996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d0de3-64d3-45cf-bf2d-9620b1435bfa None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=e05901861bc34c2398ec600150296657, role_id=a59bc76b7fc940959bb53b88e59e985c)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:32.429432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d0de3-64d3-45cf-bf2d-9620b1435bfa None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:32.467834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655bd87-732e-4726-863f-c25b693eb985 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:32.499553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31c631-92e6-4193-b81d-97836144d0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:32.500167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31c631-92e6-4193-b81d-97836144d0d8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:32.500449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31c631-92e6-4193-b81d-97836144d0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:32.500722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e31c631-92e6-4193-b81d-97836144d0d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:32.507337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 523/1074] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:32 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/e05901861bc34c2398ec600150296657/roles/a59bc76b7fc940959bb53b88e59e985c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:34:32.562550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:32.582319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31c631-92e6-4193-b81d-97836144d0d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:32.583857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e31c631-92e6-4193-b81d-97836144d0d8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:32.692220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 552/1075] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:34:32.698394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d0de3-64d3-45cf-bf2d-9620b1435bfa None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:32.735197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:32.803139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d0de3-64d3-45cf-bf2d-9620b1435bfa None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:32.838213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dbedef-991e-4aa4-a0de-916029249c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:32.838853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbedef-991e-4aa4-a0de-916029249c29 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:32.839134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbedef-991e-4aa4-a0de-916029249c29 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:32.839408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dbedef-991e-4aa4-a0de-916029249c29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:32.851166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbedef-991e-4aa4-a0de-916029249c29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:32.852726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dbedef-991e-4aa4-a0de-916029249c29 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-06dbedef-991e-4aa4-a0de-916029249c29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:32.869004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:32.870005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:32.870896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:32.870896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:32.870896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:32.870896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 524/1076] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:32.876106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31c631-92e6-4193-b81d-97836144d0d8 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:32.958839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:32.974834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e31c631-92e6-4193-b81d-97836144d0d8 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:33.012142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457172-2d7d-4e53-8632-7904e210bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:33.013141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457172-2d7d-4e53-8632-7904e210bda3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:33.013618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457172-2d7d-4e53-8632-7904e210bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:33.014116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457172-2d7d-4e53-8632-7904e210bda3 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:33.015121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457172-2d7d-4e53-8632-7904e210bda3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:33.015650 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457172-2d7d-4e53-8632-7904e210bda3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:33.017244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457172-2d7d-4e53-8632-7904e210bda3 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:33.029041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 553/1077] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:34.114640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609aa7-c47f-4ab6-8155-6a93a9bcb2db None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.115189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609aa7-c47f-4ab6-8155-6a93a9bcb2db None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.115189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16609aa7-c47f-4ab6-8155-6a93a9bcb2db None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.116563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 525/1078] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:34.121895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c47bf-09e6-4cf8-a3ed-8b99c001b58f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.122293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c47bf-09e6-4cf8-a3ed-8b99c001b58f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.122441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2c47bf-09e6-4cf8-a3ed-8b99c001b58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.140040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-fd2c47bf-09e6-4cf8-a3ed-8b99c001b58f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:34.141202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fd2c47bf-09e6-4cf8-a3ed-8b99c001b58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:34.204851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 554/1079] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:34.477134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609aa7-c47f-4ab6-8155-6a93a9bcb2db None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:34.565841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:34.579569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16609aa7-c47f-4ab6-8155-6a93a9bcb2db None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:34.614386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c07f3cb-8678-4348-a3d7-0729952132ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:34.615135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f3cb-8678-4348-a3d7-0729952132ba None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.615584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f3cb-8678-4348-a3d7-0729952132ba None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.616220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c07f3cb-8678-4348-a3d7-0729952132ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.626074 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c07f3cb-8678-4348-a3d7-0729952132ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-7c07f3cb-8678-4348-a3d7-0729952132ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:34.630793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:34.631923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:34.632827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 526/1080] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:34.637896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c47bf-09e6-4cf8-a3ed-8b99c001b58f None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:34.670454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb55c08-132e-4771-99af-44e270cc7197 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.670959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb55c08-132e-4771-99af-44e270cc7197 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.671241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb55c08-132e-4771-99af-44e270cc7197 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.672636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 527/1081] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:34:34.678032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217518c-006e-451f-8570-65c12e35a4ef None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.678316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217518c-006e-451f-8570-65c12e35a4ef None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.678589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9217518c-006e-451f-8570-65c12e35a4ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.696600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9217518c-006e-451f-8570-65c12e35a4ef None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:34.697799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9217518c-006e-451f-8570-65c12e35a4ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:34.711968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:34.735699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2c47bf-09e6-4cf8-a3ed-8b99c001b58f None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:34.763343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 528/1082] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:34:34.769146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bed9d-62d1-464d-984b-b4e421d655e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:34.769748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bed9d-62d1-464d-984b-b4e421d655e7 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.770024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bed9d-62d1-464d-984b-b4e421d655e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.770293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2bed9d-62d1-464d-984b-b4e421d655e7 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.770953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bed9d-62d1-464d-984b-b4e421d655e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:34.771253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bed9d-62d1-464d-984b-b4e421d655e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:34.773672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2bed9d-62d1-464d-984b-b4e421d655e7 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:34.781628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 555/1083] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:34.787784 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217518c-006e-451f-8570-65c12e35a4ef None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:34.905631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:34.925265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9217518c-006e-451f-8570-65c12e35a4ef None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:34.958273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187897cd-36fe-41ba-8608-0db9b589739f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:34.958886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187897cd-36fe-41ba-8608-0db9b589739f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:34.959161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187897cd-36fe-41ba-8608-0db9b589739f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:34.959432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187897cd-36fe-41ba-8608-0db9b589739f None admin] PATH_INFO: `/v3/users/6d77be9638f64dfe8a41a9a7d2410cf8` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:34.960567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187897cd-36fe-41ba-8608-0db9b589739f None admin] RBAC: Authorizing `identity:get_user(user_id=6d77be9638f64dfe8a41a9a7d2410cf8)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:34.961979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187897cd-36fe-41ba-8608-0db9b589739f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:34.963527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 529/1084] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/users/6d77be9638f64dfe8a41a9a7d2410cf8 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:34.969153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bed9d-62d1-464d-984b-b4e421d655e7 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.031381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187897cd-36fe-41ba-8608-0db9b589739f None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.066965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2bed9d-62d1-464d-984b-b4e421d655e7 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.099516 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a063e-caaa-4031-9eaf-a1d36e9d2c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.100150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a063e-caaa-4031-9eaf-a1d36e9d2c02 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.100429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a063e-caaa-4031-9eaf-a1d36e9d2c02 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.100702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634a063e-caaa-4031-9eaf-a1d36e9d2c02 None admin] PATH_INFO: `/v3/projects/256abbcb7468431abcb65117baee1d5f` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.101798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a063e-caaa-4031-9eaf-a1d36e9d2c02 None admin] RBAC: Authorizing `identity:get_project(project_id=256abbcb7468431abcb65117baee1d5f)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.103214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634a063e-caaa-4031-9eaf-a1d36e9d2c02 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.104972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 556/1085] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:34 2022] GET /identity/v3/projects/256abbcb7468431abcb65117baee1d5f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:35.110778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a063e-caaa-4031-9eaf-a1d36e9d2c02 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.114590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:35.131414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187897cd-36fe-41ba-8608-0db9b589739f None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.165304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4dc4d-7aa9-42cd-968b-eeaf8859af17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.165927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4dc4d-7aa9-42cd-968b-eeaf8859af17 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.166232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4dc4d-7aa9-42cd-968b-eeaf8859af17 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.166504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac4dc4d-7aa9-42cd-968b-eeaf8859af17 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.177337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac4dc4d-7aa9-42cd-968b-eeaf8859af17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-7ac4dc4d-7aa9-42cd-968b-eeaf8859af17 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:35.182098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:35.183125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:35.184497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 530/1086] 10.222.0.25 () {56 vars in 1120 bytes} [Tue Oct 4 08:34:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:35.189015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4dc4d-7aa9-42cd-968b-eeaf8859af17 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.199248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:35.210681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634a063e-caaa-4031-9eaf-a1d36e9d2c02 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.243839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144b808-1943-493f-9a4c-3118b2bd07ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.244514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144b808-1943-493f-9a4c-3118b2bd07ac None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.244801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144b808-1943-493f-9a4c-3118b2bd07ac None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.245076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0144b808-1943-493f-9a4c-3118b2bd07ac None admin] PATH_INFO: `/v3/projects/256abbcb7468431abcb65117baee1d5f/users/6d77be9638f64dfe8a41a9a7d2410cf8/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.246995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144b808-1943-493f-9a4c-3118b2bd07ac None admin] RBAC: Authorizing `identity:create_grant(project_id=256abbcb7468431abcb65117baee1d5f, user_id=6d77be9638f64dfe8a41a9a7d2410cf8, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.248462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0144b808-1943-493f-9a4c-3118b2bd07ac None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.287956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac4dc4d-7aa9-42cd-968b-eeaf8859af17 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.324108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9496a4-badc-4bb0-8c73-fc2b84e9b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.324708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9496a4-badc-4bb0-8c73-fc2b84e9b1db None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.324987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9496a4-badc-4bb0-8c73-fc2b84e9b1db None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.325263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9496a4-badc-4bb0-8c73-fc2b84e9b1db None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.325928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9496a4-badc-4bb0-8c73-fc2b84e9b1db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:35.326287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9496a4-badc-4bb0-8c73-fc2b84e9b1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.327640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9496a4-badc-4bb0-8c73-fc2b84e9b1db None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.335385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 531/1087] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 08:34:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:35.338133 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 557/1088] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:35 2022] PUT /identity/v3/projects/256abbcb7468431abcb65117baee1d5f/users/6d77be9638f64dfe8a41a9a7d2410cf8/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:34:35.341285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9496a4-badc-4bb0-8c73-fc2b84e9b1db None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.411374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:35.446597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9496a4-badc-4bb0-8c73-fc2b84e9b1db None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.481263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c23cb2-e521-4db4-b3e1-061182225a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.481907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c23cb2-e521-4db4-b3e1-061182225a0b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.482180 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c23cb2-e521-4db4-b3e1-061182225a0b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.482449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c23cb2-e521-4db4-b3e1-061182225a0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.494235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c23cb2-e521-4db4-b3e1-061182225a0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.495684 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c23cb2-e521-4db4-b3e1-061182225a0b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-27c23cb2-e521-4db4-b3e1-061182225a0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:35.512024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:35.513026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:35.513948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:35.513948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:35.513948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:35.513948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 532/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:35.519021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144b808-1943-493f-9a4c-3118b2bd07ac None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.580623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:35.618821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0144b808-1943-493f-9a4c-3118b2bd07ac None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.651876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b38829-d83b-4a17-8b79-7603aee5986e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.652487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b38829-d83b-4a17-8b79-7603aee5986e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.652771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b38829-d83b-4a17-8b79-7603aee5986e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.653046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b38829-d83b-4a17-8b79-7603aee5986e None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.653688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b38829-d83b-4a17-8b79-7603aee5986e None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:35.653992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b38829-d83b-4a17-8b79-7603aee5986e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.655350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b38829-d83b-4a17-8b79-7603aee5986e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.668033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 558/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:35.674236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c23cb2-e521-4db4-b3e1-061182225a0b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.770792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c23cb2-e521-4db4-b3e1-061182225a0b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.789622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:35.803728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1c05e-f6e3-434b-9328-02b1845e6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.804358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1c05e-f6e3-434b-9328-02b1845e6ae7 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.804640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1c05e-f6e3-434b-9328-02b1845e6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.804910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1c05e-f6e3-434b-9328-02b1845e6ae7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.812168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1c05e-f6e3-434b-9328-02b1845e6ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.813585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1c05e-f6e3-434b-9328-02b1845e6ae7 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-a1c1c05e-f6e3-434b-9328-02b1845e6ae7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:34:35.824878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:35.825997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:35.826954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 533/1091] 10.222.0.25 () {56 vars in 1093 bytes} [Tue Oct 4 08:34:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:35.831919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b38829-d83b-4a17-8b79-7603aee5986e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:35.928779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b38829-d83b-4a17-8b79-7603aee5986e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:35.951549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:35.962170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363b318-9508-4276-8a38-ee7e7f7ec6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:35.962862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363b318-9508-4276-8a38-ee7e7f7ec6e8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:35.963144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363b318-9508-4276-8a38-ee7e7f7ec6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:35.963418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363b318-9508-4276-8a38-ee7e7f7ec6e8 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:35.964173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363b318-9508-4276-8a38-ee7e7f7ec6e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:35.964482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363b318-9508-4276-8a38-ee7e7f7ec6e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:35.965899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c363b318-9508-4276-8a38-ee7e7f7ec6e8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:35.982759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 559/1092] 10.222.0.25 () {56 vars in 1133 bytes} [Tue Oct 4 08:34:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:35.988938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1c05e-f6e3-434b-9328-02b1845e6ae7 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.086563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1c05e-f6e3-434b-9328-02b1845e6ae7 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.119347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec9dde-9e6b-404d-906c-c8450ffbe433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.119979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9dde-9e6b-404d-906c-c8450ffbe433 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.120262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9dde-9e6b-404d-906c-c8450ffbe433 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.120537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec9dde-9e6b-404d-906c-c8450ffbe433 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.167328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:36.187267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec9dde-9e6b-404d-906c-c8450ffbe433 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.188728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec9dde-9e6b-404d-906c-c8450ffbe433 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.285721 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 534/1093] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 04 08:34:36.291666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363b318-9508-4276-8a38-ee7e7f7ec6e8 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.386834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363b318-9508-4276-8a38-ee7e7f7ec6e8 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.419252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653a99c-a786-4423-8845-4714cb14934a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.419928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a99c-a786-4423-8845-4714cb14934a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.420209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a99c-a786-4423-8845-4714cb14934a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.420482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b653a99c-a786-4423-8845-4714cb14934a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.430966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a99c-a786-4423-8845-4714cb14934a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.432428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b653a99c-a786-4423-8845-4714cb14934a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-b653a99c-a786-4423-8845-4714cb14934a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:34:36.446556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:36.447662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:34:36.448571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:34:36.448571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:34:36.448571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:36.448571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 560/1094] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:36.453249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec9dde-9e6b-404d-906c-c8450ffbe433 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.530971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:36.552411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec9dde-9e6b-404d-906c-c8450ffbe433 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.585711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd64374-7d1d-4696-88db-82a224ceb411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.586313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd64374-7d1d-4696-88db-82a224ceb411 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.586586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd64374-7d1d-4696-88db-82a224ceb411 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.586854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd64374-7d1d-4696-88db-82a224ceb411 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.587486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd64374-7d1d-4696-88db-82a224ceb411 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:36.587815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd64374-7d1d-4696-88db-82a224ceb411 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.590761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd64374-7d1d-4696-88db-82a224ceb411 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.602188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 535/1095] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:36.607887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653a99c-a786-4423-8845-4714cb14934a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.640571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:36.704084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b653a99c-a786-4423-8845-4714cb14934a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.736664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa39d42-f72a-4291-a163-061e479166d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.737299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa39d42-f72a-4291-a163-061e479166d6 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.737576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa39d42-f72a-4291-a163-061e479166d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.737845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa39d42-f72a-4291-a163-061e479166d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.744121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa39d42-f72a-4291-a163-061e479166d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.745533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa39d42-f72a-4291-a163-061e479166d6 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-dfa39d42-f72a-4291-a163-061e479166d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:34:36.756249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:36.757331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:36.763393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:34:36.763393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:34:36.763393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:34:36.763393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:34:36.763393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:34:36.763393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:34:36.763393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:34:36.763393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:34:36.763393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 561/1096] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:34:36.763970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd64374-7d1d-4696-88db-82a224ceb411 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:36.861199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd64374-7d1d-4696-88db-82a224ceb411 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:36.893870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40003b44-0683-49d2-a30d-995e48d9cdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:36.894405 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003b44-0683-49d2-a30d-995e48d9cdcd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:36.894683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003b44-0683-49d2-a30d-995e48d9cdcd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:36.894953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40003b44-0683-49d2-a30d-995e48d9cdcd None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:36.895680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40003b44-0683-49d2-a30d-995e48d9cdcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:36.895983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40003b44-0683-49d2-a30d-995e48d9cdcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:36.897389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40003b44-0683-49d2-a30d-995e48d9cdcd None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:36.906002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:36.909606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 536/1097] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:36.916630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa39d42-f72a-4291-a163-061e479166d6 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.007233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:37.013597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa39d42-f72a-4291-a163-061e479166d6 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.046444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c02e03-0316-4179-be3d-def22ae3b80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.047040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c02e03-0316-4179-be3d-def22ae3b80f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.047316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c02e03-0316-4179-be3d-def22ae3b80f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.047611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c02e03-0316-4179-be3d-def22ae3b80f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.048484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c02e03-0316-4179-be3d-def22ae3b80f None admin] RBAC: Adding query filter params (role.id=a59bc76b7fc940959bb53b88e59e985c, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=e05901861bc34c2398ec600150296657) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:37.048792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c02e03-0316-4179-be3d-def22ae3b80f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:37.050194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c02e03-0316-4179-be3d-def22ae3b80f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:37.056062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 562/1098] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:36 2022] GET /identity/v3/role_assignments?user.id=e05901861bc34c2398ec600150296657&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=a59bc76b7fc940959bb53b88e59e985c => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:37.463213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752306d-028f-4cc5-aff4-d125a76a6cbe None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.463920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752306d-028f-4cc5-aff4-d125a76a6cbe None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.463920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6752306d-028f-4cc5-aff4-d125a76a6cbe None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.465139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 537/1099] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:37.470459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78d542-82da-4563-8df3-beca90873cde None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.470912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78d542-82da-4563-8df3-beca90873cde None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.471004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d78d542-82da-4563-8df3-beca90873cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.489440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9d78d542-82da-4563-8df3-beca90873cde None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:37.490615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9d78d542-82da-4563-8df3-beca90873cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:37.556968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 563/1100] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:37.826152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752306d-028f-4cc5-aff4-d125a76a6cbe None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:37.926981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6752306d-028f-4cc5-aff4-d125a76a6cbe None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:37.959967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319dbc8-7673-4e77-b444-c933c7a574c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:37.960590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319dbc8-7673-4e77-b444-c933c7a574c4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:37.960870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319dbc8-7673-4e77-b444-c933c7a574c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:37.961142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2319dbc8-7673-4e77-b444-c933c7a574c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:37.970753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2319dbc8-7673-4e77-b444-c933c7a574c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-2319dbc8-7673-4e77-b444-c933c7a574c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:37.975633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:37.976716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:37.977754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 538/1101] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:37.982688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78d542-82da-4563-8df3-beca90873cde None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.065313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.093444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d78d542-82da-4563-8df3-beca90873cde None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.114084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb642332-57b0-443f-bd21-d955e6ac5142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.114676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb642332-57b0-443f-bd21-d955e6ac5142 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.114955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb642332-57b0-443f-bd21-d955e6ac5142 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.115223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb642332-57b0-443f-bd21-d955e6ac5142 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.115903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb642332-57b0-443f-bd21-d955e6ac5142 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:38.116200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb642332-57b0-443f-bd21-d955e6ac5142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.117556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb642332-57b0-443f-bd21-d955e6ac5142 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.125074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 564/1102] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:38.131697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319dbc8-7673-4e77-b444-c933c7a574c4 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.188190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.225933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2319dbc8-7673-4e77-b444-c933c7a574c4 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.258283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c1be5-e9d9-457d-88cc-241fcbd259b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.258889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c1be5-e9d9-457d-88cc-241fcbd259b6 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.259169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c1be5-e9d9-457d-88cc-241fcbd259b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.259444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710c1be5-e9d9-457d-88cc-241fcbd259b6 None admin] PATH_INFO: `/v3/users/6d77be9638f64dfe8a41a9a7d2410cf8` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.260652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c1be5-e9d9-457d-88cc-241fcbd259b6 None admin] RBAC: Authorizing `identity:get_user(user_id=6d77be9638f64dfe8a41a9a7d2410cf8)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.262068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710c1be5-e9d9-457d-88cc-241fcbd259b6 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.263630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 539/1103] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/users/6d77be9638f64dfe8a41a9a7d2410cf8 => generated 285 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:38.269363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb642332-57b0-443f-bd21-d955e6ac5142 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.363647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb642332-57b0-443f-bd21-d955e6ac5142 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.395243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f6185-5bf4-415f-b97b-df47fa4018bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.395852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f6185-5bf4-415f-b97b-df47fa4018bb None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.396131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f6185-5bf4-415f-b97b-df47fa4018bb None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.396401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f6185-5bf4-415f-b97b-df47fa4018bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.413827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.461241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f6185-5bf4-415f-b97b-df47fa4018bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.462682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f6185-5bf4-415f-b97b-df47fa4018bb None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.555737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 565/1104] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:38.561555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c1be5-e9d9-457d-88cc-241fcbd259b6 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.657271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710c1be5-e9d9-457d-88cc-241fcbd259b6 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.682876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.690351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1f365b-5f3a-4c63-a9c8-4b864f6f43b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.690971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f365b-5f3a-4c63-a9c8-4b864f6f43b8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.691316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f365b-5f3a-4c63-a9c8-4b864f6f43b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.691569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1f365b-5f3a-4c63-a9c8-4b864f6f43b8 None admin] PATH_INFO: `/v3/projects/256abbcb7468431abcb65117baee1d5f` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.705181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f365b-5f3a-4c63-a9c8-4b864f6f43b8 None admin] RBAC: Authorizing `identity:get_project(project_id=256abbcb7468431abcb65117baee1d5f)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.705181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1f365b-5f3a-4c63-a9c8-4b864f6f43b8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.705181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 540/1105] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/projects/256abbcb7468431abcb65117baee1d5f => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:38.705601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f6185-5bf4-415f-b97b-df47fa4018bb None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:38.749698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:38.799371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f6185-5bf4-415f-b97b-df47fa4018bb None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:38.833023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec364068-b6bb-4185-9e2d-430eea619577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:38.833613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec364068-b6bb-4185-9e2d-430eea619577 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:38.833894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec364068-b6bb-4185-9e2d-430eea619577 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:38.834169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec364068-b6bb-4185-9e2d-430eea619577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:38.834890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec364068-b6bb-4185-9e2d-430eea619577 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=256abbcb7468431abcb65117baee1d5f, user.id=6d77be9638f64dfe8a41a9a7d2410cf8) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:38.835200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec364068-b6bb-4185-9e2d-430eea619577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:38.836647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec364068-b6bb-4185-9e2d-430eea619577 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:38.842163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 566/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:38 2022] GET /identity/v3/role_assignments?user.id=6d77be9638f64dfe8a41a9a7d2410cf8&scope.project.id=256abbcb7468431abcb65117baee1d5f&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:40.994291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d7f8-1161-4cd9-be91-40274995a17c None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:40.994818 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d7f8-1161-4cd9-be91-40274995a17c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:40.994818 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f24d7f8-1161-4cd9-be91-40274995a17c None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:40.996168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 541/1107] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:41.001282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b96c-fe52-4164-8200-53c2272fa579 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.001725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b96c-fe52-4164-8200-53c2272fa579 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.001841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08b96c-fe52-4164-8200-53c2272fa579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.019927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-0d08b96c-fe52-4164-8200-53c2272fa579 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:41.021108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0d08b96c-fe52-4164-8200-53c2272fa579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:41.084237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 567/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:41.350584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24d7f8-1161-4cd9-be91-40274995a17c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.448353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f24d7f8-1161-4cd9-be91-40274995a17c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.480368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78661f9-0690-4b2a-9274-eaa514194284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.480979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78661f9-0690-4b2a-9274-eaa514194284 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.481256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78661f9-0690-4b2a-9274-eaa514194284 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.481528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78661f9-0690-4b2a-9274-eaa514194284 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.482626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78661f9-0690-4b2a-9274-eaa514194284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.484066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78661f9-0690-4b2a-9274-eaa514194284 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.485594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 542/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:41.491313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b96c-fe52-4164-8200-53c2272fa579 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:41.534793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:41.587389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08b96c-fe52-4164-8200-53c2272fa579 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:41.619392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0657c1-a7df-42c0-ad46-e70cbf345648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:41.619963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0657c1-a7df-42c0-ad46-e70cbf345648 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:41.620246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0657c1-a7df-42c0-ad46-e70cbf345648 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:41.620519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0657c1-a7df-42c0-ad46-e70cbf345648 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:41.621165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0657c1-a7df-42c0-ad46-e70cbf345648 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:41.622584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0657c1-a7df-42c0-ad46-e70cbf345648 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:41.711564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 568/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:34:41 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:43.879538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933335e3-3fd3-40a9-90a6-978a966439a5 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.880040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933335e3-3fd3-40a9-90a6-978a966439a5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.880040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933335e3-3fd3-40a9-90a6-978a966439a5 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.881338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 543/1111] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:43.886535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8c45f-7d11-4404-a2fe-6c949069bfa4 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:43.886970 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8c45f-7d11-4404-a2fe-6c949069bfa4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:43.887079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8c45f-7d11-4404-a2fe-6c949069bfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:43.905683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-5fc8c45f-7d11-4404-a2fe-6c949069bfa4 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:43.906901 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-5fc8c45f-7d11-4404-a2fe-6c949069bfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:43.970857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 569/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:44.248951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933335e3-3fd3-40a9-90a6-978a966439a5 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:44.310704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:44.348064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933335e3-3fd3-40a9-90a6-978a966439a5 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.380885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c455784-4ee2-4f97-9b8e-ebb94be718c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.381567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c455784-4ee2-4f97-9b8e-ebb94be718c1 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.381848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c455784-4ee2-4f97-9b8e-ebb94be718c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.382121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c455784-4ee2-4f97-9b8e-ebb94be718c1 None admin] PATH_INFO: `/v3/roles/8715982a4ad3427498d1a73a6891b4d3` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.383494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c455784-4ee2-4f97-9b8e-ebb94be718c1 None admin] RBAC: Authorizing `identity:get_role(role_id=8715982a4ad3427498d1a73a6891b4d3)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.384863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c455784-4ee2-4f97-9b8e-ebb94be718c1 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.386158 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 544/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:44 2022] GET /identity/v3/roles/8715982a4ad3427498d1a73a6891b4d3 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:44.392104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8c45f-7d11-4404-a2fe-6c949069bfa4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:44.420677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:44.487520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8c45f-7d11-4404-a2fe-6c949069bfa4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.520197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020027fd-2221-4b09-80b0-b1ceddb88436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.520751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020027fd-2221-4b09-80b0-b1ceddb88436 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.521027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020027fd-2221-4b09-80b0-b1ceddb88436 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.521298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020027fd-2221-4b09-80b0-b1ceddb88436 None admin] PATH_INFO: `/v3/users/ee90c8db617446bdb7add063aff3ef6f` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.534295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020027fd-2221-4b09-80b0-b1ceddb88436 None admin] RBAC: Authorizing `identity:get_user(user_id=ee90c8db617446bdb7add063aff3ef6f)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.535750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020027fd-2221-4b09-80b0-b1ceddb88436 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.537343 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 570/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:44 2022] GET /identity/v3/users/ee90c8db617446bdb7add063aff3ef6f => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:44.543053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c455784-4ee2-4f97-9b8e-ebb94be718c1 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:44.638711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c455784-4ee2-4f97-9b8e-ebb94be718c1 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.666117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:44.670815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c6c71-8323-4424-b977-d4b1a0e08d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.671412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c6c71-8323-4424-b977-d4b1a0e08d49 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.671719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c6c71-8323-4424-b977-d4b1a0e08d49 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.671995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c6c71-8323-4424-b977-d4b1a0e08d49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.739138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c6c71-8323-4424-b977-d4b1a0e08d49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.740641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c6c71-8323-4424-b977-d4b1a0e08d49 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.834127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 545/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:44.840138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020027fd-2221-4b09-80b0-b1ceddb88436 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:44.923597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:44.935144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020027fd-2221-4b09-80b0-b1ceddb88436 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:44.967559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3024284-7214-4343-973f-fc61eb865233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:44.968175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3024284-7214-4343-973f-fc61eb865233 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:44.968455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3024284-7214-4343-973f-fc61eb865233 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:44.968726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3024284-7214-4343-973f-fc61eb865233 None admin] PATH_INFO: `/v3/projects/256abbcb7468431abcb65117baee1d5f` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:44.969823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3024284-7214-4343-973f-fc61eb865233 None admin] RBAC: Authorizing `identity:get_project(project_id=256abbcb7468431abcb65117baee1d5f)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:44.971825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3024284-7214-4343-973f-fc61eb865233 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:44.973396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 571/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:44 2022] GET /identity/v3/projects/256abbcb7468431abcb65117baee1d5f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:44.979474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c6c71-8323-4424-b977-d4b1a0e08d49 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:45.009867 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:45.075612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c6c71-8323-4424-b977-d4b1a0e08d49 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:45.107308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa46cdef-9f4b-469f-b026-5c083c9d0022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:45.107882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46cdef-9f4b-469f-b026-5c083c9d0022 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:45.108165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46cdef-9f4b-469f-b026-5c083c9d0022 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:45.108441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa46cdef-9f4b-469f-b026-5c083c9d0022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:45.109161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46cdef-9f4b-469f-b026-5c083c9d0022 None admin] RBAC: Adding query filter params (role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=256abbcb7468431abcb65117baee1d5f, user.id=ee90c8db617446bdb7add063aff3ef6f) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:45.109471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46cdef-9f4b-469f-b026-5c083c9d0022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:45.111371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa46cdef-9f4b-469f-b026-5c083c9d0022 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:45.116546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 546/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:44 2022] GET /identity/v3/role_assignments?user.id=ee90c8db617446bdb7add063aff3ef6f&scope.project.id=256abbcb7468431abcb65117baee1d5f&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:47.225607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24509bc7-0d4a-42a1-8084-dea07716fcc3 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.226161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24509bc7-0d4a-42a1-8084-dea07716fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.226161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24509bc7-0d4a-42a1-8084-dea07716fcc3 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.227483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 572/1118] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:47 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:47.232699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c043f-e5cb-4214-bdf2-8387805f6d36 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.233152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c043f-e5cb-4214-bdf2-8387805f6d36 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.233254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c043f-e5cb-4214-bdf2-8387805f6d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.252053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-df8c043f-e5cb-4214-bdf2-8387805f6d36 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:47.253265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-df8c043f-e5cb-4214-bdf2-8387805f6d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:47.316840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 547/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:47.585660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24509bc7-0d4a-42a1-8084-dea07716fcc3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.683152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24509bc7-0d4a-42a1-8084-dea07716fcc3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.716014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71b06-b325-4a6f-ae5a-4c8b50065693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.716630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71b06-b325-4a6f-ae5a-4c8b50065693 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.716913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71b06-b325-4a6f-ae5a-4c8b50065693 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.717189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f71b06-b325-4a6f-ae5a-4c8b50065693 None admin] PATH_INFO: `/v3/roles/8715982a4ad3427498d1a73a6891b4d3` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.718570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71b06-b325-4a6f-ae5a-4c8b50065693 None admin] RBAC: Authorizing `identity:get_role(role_id=8715982a4ad3427498d1a73a6891b4d3)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.719963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f71b06-b325-4a6f-ae5a-4c8b50065693 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.721770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 573/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/roles/8715982a4ad3427498d1a73a6891b4d3 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:47.727562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c043f-e5cb-4214-bdf2-8387805f6d36 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.753371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.823258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c043f-e5cb-4214-bdf2-8387805f6d36 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.856186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c6e2d-9a7e-4e3d-bb4b-7601732a9b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.856751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c6e2d-9a7e-4e3d-bb4b-7601732a9b05 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.857030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c6e2d-9a7e-4e3d-bb4b-7601732a9b05 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.857304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8c6e2d-9a7e-4e3d-bb4b-7601732a9b05 None admin] PATH_INFO: `/v3/users/ee90c8db617446bdb7add063aff3ef6f` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.858399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c6e2d-9a7e-4e3d-bb4b-7601732a9b05 None admin] RBAC: Authorizing `identity:get_user(user_id=ee90c8db617446bdb7add063aff3ef6f)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.859848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8c6e2d-9a7e-4e3d-bb4b-7601732a9b05 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:47.861415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 548/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/users/ee90c8db617446bdb7add063aff3ef6f => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:47.867124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71b06-b325-4a6f-ae5a-4c8b50065693 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:47.891661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:47.963127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f71b06-b325-4a6f-ae5a-4c8b50065693 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:47.995747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92708d58-c043-482f-8e23-9a546495c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:47.996362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92708d58-c043-482f-8e23-9a546495c903 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:47.996641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92708d58-c043-482f-8e23-9a546495c903 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:47.996912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92708d58-c043-482f-8e23-9a546495c903 None admin] PATH_INFO: `/v3/projects/256abbcb7468431abcb65117baee1d5f` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:47.998004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92708d58-c043-482f-8e23-9a546495c903 None admin] RBAC: Authorizing `identity:get_project(project_id=256abbcb7468431abcb65117baee1d5f)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:47.999448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92708d58-c043-482f-8e23-9a546495c903 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:48.001141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 574/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:47 2022] GET /identity/v3/projects/256abbcb7468431abcb65117baee1d5f => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:48.006857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c6e2d-9a7e-4e3d-bb4b-7601732a9b05 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:48.094939 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:48.101788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8c6e2d-9a7e-4e3d-bb4b-7601732a9b05 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:48.133023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971a2ab-d061-4581-8a7b-36158295cafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:48.133590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971a2ab-d061-4581-8a7b-36158295cafc None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:48.133865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971a2ab-d061-4581-8a7b-36158295cafc None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:48.134133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971a2ab-d061-4581-8a7b-36158295cafc None admin] PATH_INFO: `/v3/projects/256abbcb7468431abcb65117baee1d5f/users/ee90c8db617446bdb7add063aff3ef6f/roles/8715982a4ad3427498d1a73a6891b4d3` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:48.136243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971a2ab-d061-4581-8a7b-36158295cafc None admin] RBAC: Authorizing `identity:create_grant(project_id=256abbcb7468431abcb65117baee1d5f, user_id=ee90c8db617446bdb7add063aff3ef6f, role_id=8715982a4ad3427498d1a73a6891b4d3)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:48.137641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7971a2ab-d061-4581-8a7b-36158295cafc None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:48.213938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 549/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:34:48 2022] PUT /identity/v3/projects/256abbcb7468431abcb65117baee1d5f/users/ee90c8db617446bdb7add063aff3ef6f/roles/8715982a4ad3427498d1a73a6891b4d3 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:34:50.328838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bcd4c-7129-425d-b5fa-8705b4ab7402 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.329376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bcd4c-7129-425d-b5fa-8705b4ab7402 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.329376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887bcd4c-7129-425d-b5fa-8705b4ab7402 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.331192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 575/1124] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:50.336356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce7e7-51e9-4461-8867-3accb4992473 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.336742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce7e7-51e9-4461-8867-3accb4992473 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.336912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce7e7-51e9-4461-8867-3accb4992473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.355086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-977ce7e7-51e9-4461-8867-3accb4992473 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:50.356305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-977ce7e7-51e9-4461-8867-3accb4992473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:50.419826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 550/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:50.687431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bcd4c-7129-425d-b5fa-8705b4ab7402 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.774931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.784633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887bcd4c-7129-425d-b5fa-8705b4ab7402 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.816724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59e43b-b6ca-4996-8ab0-15884704bfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.817332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59e43b-b6ca-4996-8ab0-15884704bfc0 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.817703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59e43b-b6ca-4996-8ab0-15884704bfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.817979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a59e43b-b6ca-4996-8ab0-15884704bfc0 None admin] PATH_INFO: `/v3/roles/8715982a4ad3427498d1a73a6891b4d3` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.819421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59e43b-b6ca-4996-8ab0-15884704bfc0 None admin] RBAC: Authorizing `identity:get_role(role_id=8715982a4ad3427498d1a73a6891b4d3)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.820844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a59e43b-b6ca-4996-8ab0-15884704bfc0 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.822168 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 576/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/roles/8715982a4ad3427498d1a73a6891b4d3 => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:50.827826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce7e7-51e9-4461-8867-3accb4992473 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:50.915744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:50.930894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce7e7-51e9-4461-8867-3accb4992473 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:50.964036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f2e65-ebc9-49a4-843e-b29ee80a64ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:50.964679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f2e65-ebc9-49a4-843e-b29ee80a64ce None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:50.964959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f2e65-ebc9-49a4-843e-b29ee80a64ce None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:50.965232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f2e65-ebc9-49a4-843e-b29ee80a64ce None admin] PATH_INFO: `/v3/users/ee90c8db617446bdb7add063aff3ef6f` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:50.966339 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f2e65-ebc9-49a4-843e-b29ee80a64ce None admin] RBAC: Authorizing `identity:get_user(user_id=ee90c8db617446bdb7add063aff3ef6f)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:50.967776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f2e65-ebc9-49a4-843e-b29ee80a64ce None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:50.969338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 551/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/users/ee90c8db617446bdb7add063aff3ef6f => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:50.975683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59e43b-b6ca-4996-8ab0-15884704bfc0 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.069748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a59e43b-b6ca-4996-8ab0-15884704bfc0 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.102464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35af7f-1889-4f50-919f-3951aa98668f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.103052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35af7f-1889-4f50-919f-3951aa98668f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.103333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35af7f-1889-4f50-919f-3951aa98668f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.103635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef35af7f-1889-4f50-919f-3951aa98668f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.129152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:51.167835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35af7f-1889-4f50-919f-3951aa98668f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.169200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef35af7f-1889-4f50-919f-3951aa98668f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.260460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 577/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:34:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:34:51.266275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f2e65-ebc9-49a4-843e-b29ee80a64ce None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.360722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f2e65-ebc9-49a4-843e-b29ee80a64ce None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.393737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c2aad-5a8a-41da-8bf2-2f26732d015b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.394351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c2aad-5a8a-41da-8bf2-2f26732d015b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.394627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c2aad-5a8a-41da-8bf2-2f26732d015b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.394894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c2aad-5a8a-41da-8bf2-2f26732d015b None admin] PATH_INFO: `/v3/projects/256abbcb7468431abcb65117baee1d5f` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.396020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c2aad-5a8a-41da-8bf2-2f26732d015b None admin] RBAC: Authorizing `identity:get_project(project_id=256abbcb7468431abcb65117baee1d5f)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.397416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c2aad-5a8a-41da-8bf2-2f26732d015b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.399010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 552/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:34:51 2022] GET /identity/v3/projects/256abbcb7468431abcb65117baee1d5f => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:51.405201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35af7f-1889-4f50-919f-3951aa98668f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:51.461712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:51.499111 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef35af7f-1889-4f50-919f-3951aa98668f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:51.532265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb46a90-4990-48d8-a2c4-a3dff8e7ec0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:51.532863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb46a90-4990-48d8-a2c4-a3dff8e7ec0e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:51.533142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb46a90-4990-48d8-a2c4-a3dff8e7ec0e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:51.533414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb46a90-4990-48d8-a2c4-a3dff8e7ec0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:51.534131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb46a90-4990-48d8-a2c4-a3dff8e7ec0e None admin] RBAC: Adding query filter params (role.id=8715982a4ad3427498d1a73a6891b4d3, scope.project.id=256abbcb7468431abcb65117baee1d5f, user.id=ee90c8db617446bdb7add063aff3ef6f) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:34:51.534436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb46a90-4990-48d8-a2c4-a3dff8e7ec0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:51.535950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb46a90-4990-48d8-a2c4-a3dff8e7ec0e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:51.541459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 578/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:34:51 2022] GET /identity/v3/role_assignments?user.id=ee90c8db617446bdb7add063aff3ef6f&scope.project.id=256abbcb7468431abcb65117baee1d5f&role.id=8715982a4ad3427498d1a73a6891b4d3 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:53.690951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8b23a-44b9-4b13-8101-985d3ea5ca54 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.691477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8b23a-44b9-4b13-8101-985d3ea5ca54 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.691477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8b23a-44b9-4b13-8101-985d3ea5ca54 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.692924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 553/1131] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:53.698173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6916f-b0cf-4231-a53a-2ab0f490927b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:53.698542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6916f-b0cf-4231-a53a-2ab0f490927b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:53.698724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6916f-b0cf-4231-a53a-2ab0f490927b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:53.716989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-49f6916f-b0cf-4231-a53a-2ab0f490927b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:53.718162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-49f6916f-b0cf-4231-a53a-2ab0f490927b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:53.781080 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 579/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:54.055839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8b23a-44b9-4b13-8101-985d3ea5ca54 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:54.077346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:54.161344 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8b23a-44b9-4b13-8101-985d3ea5ca54 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:54.193646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5be0c6-9b8c-409d-a1d8-b4af15acd6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:54.194254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5be0c6-9b8c-409d-a1d8-b4af15acd6ce None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:54.194532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5be0c6-9b8c-409d-a1d8-b4af15acd6ce None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:54.194802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5be0c6-9b8c-409d-a1d8-b4af15acd6ce None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:54.195922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5be0c6-9b8c-409d-a1d8-b4af15acd6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:54.197328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5be0c6-9b8c-409d-a1d8-b4af15acd6ce None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:54.198856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 554/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:34:54.204803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6916f-b0cf-4231-a53a-2ab0f490927b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:54.257120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:54.300183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6916f-b0cf-4231-a53a-2ab0f490927b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:54.332169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616e4bd-064b-4efd-a1db-e68dad878ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:54.332704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e4bd-064b-4efd-a1db-e68dad878ef8 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:54.332984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e4bd-064b-4efd-a1db-e68dad878ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:54.333256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616e4bd-064b-4efd-a1db-e68dad878ef8 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:54.333906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616e4bd-064b-4efd-a1db-e68dad878ef8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:54.335326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616e4bd-064b-4efd-a1db-e68dad878ef8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:54.417363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 580/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:34:54 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:34:56.576780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9625caa-fee1-4f1c-820c-09a7f783e26e None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.577324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9625caa-fee1-4f1c-820c-09a7f783e26e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.577324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9625caa-fee1-4f1c-820c-09a7f783e26e None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.578641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 555/1135] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:56.584594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098d2f0-522b-4f46-a9ed-fcb05e456eca None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:56.584977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098d2f0-522b-4f46-a9ed-fcb05e456eca None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:56.585142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098d2f0-522b-4f46-a9ed-fcb05e456eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:56.602739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8098d2f0-522b-4f46-a9ed-fcb05e456eca None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:56.603955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8098d2f0-522b-4f46-a9ed-fcb05e456eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:56.667116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 581/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:56.935170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9625caa-fee1-4f1c-820c-09a7f783e26e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:57.020640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:57.032668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9625caa-fee1-4f1c-820c-09a7f783e26e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:57.066177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d3573-fc18-4abd-aa4d-faa99c6d67b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:57.066791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d3573-fc18-4abd-aa4d-faa99c6d67b4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.067067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d3573-fc18-4abd-aa4d-faa99c6d67b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.067338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d3573-fc18-4abd-aa4d-faa99c6d67b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.068475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d3573-fc18-4abd-aa4d-faa99c6d67b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:57.069883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d3573-fc18-4abd-aa4d-faa99c6d67b4 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:57.071424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 556/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:34:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:34:57.077221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098d2f0-522b-4f46-a9ed-fcb05e456eca None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:57.109087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:34:57.169586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098d2f0-522b-4f46-a9ed-fcb05e456eca None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:57.202939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e158695-6a65-485c-bd63-d19a30b44f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:57.203544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e158695-6a65-485c-bd63-d19a30b44f58 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:57.203826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e158695-6a65-485c-bd63-d19a30b44f58 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:57.204096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e158695-6a65-485c-bd63-d19a30b44f58 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:57.204780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e158695-6a65-485c-bd63-d19a30b44f58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:34:57.206185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e158695-6a65-485c-bd63-d19a30b44f58 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:34:57.308612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 582/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:34:57 2022] POST /identity/v3/users => generated 286 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:34:59.459477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8d62a-c226-46f5-ad0a-8688484cc684 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.460034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8d62a-c226-46f5-ad0a-8688484cc684 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.460034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8d62a-c226-46f5-ad0a-8688484cc684 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.461377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 557/1139] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:34:59.466672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807902-e186-4683-a0bb-d56c873de0d2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.467067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807902-e186-4683-a0bb-d56c873de0d2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.467502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5807902-e186-4683-a0bb-d56c873de0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.485637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b5807902-e186-4683-a0bb-d56c873de0d2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:34:59.487396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b5807902-e186-4683-a0bb-d56c873de0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:34:59.551403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 583/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:34:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:34:59.824910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8d62a-c226-46f5-ad0a-8688484cc684 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:59.920274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8d62a-c226-46f5-ad0a-8688484cc684 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:34:59.952975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b5458-71ed-47fc-ac7c-17b1bcc926cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:34:59.953582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b5458-71ed-47fc-ac7c-17b1bcc926cd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:34:59.953861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b5458-71ed-47fc-ac7c-17b1bcc926cd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:34:59.954130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37b5458-71ed-47fc-ac7c-17b1bcc926cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:34:59.963674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37b5458-71ed-47fc-ac7c-17b1bcc926cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-d37b5458-71ed-47fc-ac7c-17b1bcc926cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:34:59.968350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:34:59.969512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:34:59.970582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 558/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:34:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:34:59.975362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807902-e186-4683-a0bb-d56c873de0d2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:34:59.998229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:00.070359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5807902-e186-4683-a0bb-d56c873de0d2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.103250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f5a2e-c4a2-4436-a5f5-e37d40eb8c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.103815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f5a2e-c4a2-4436-a5f5-e37d40eb8c56 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.104097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f5a2e-c4a2-4436-a5f5-e37d40eb8c56 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.104366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f5a2e-c4a2-4436-a5f5-e37d40eb8c56 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.105029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f5a2e-c4a2-4436-a5f5-e37d40eb8c56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:00.105331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f5a2e-c4a2-4436-a5f5-e37d40eb8c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.106673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2f5a2e-c4a2-4436-a5f5-e37d40eb8c56 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.114311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 584/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:34:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:00.120100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b5458-71ed-47fc-ac7c-17b1bcc926cd None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.137803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:00.215365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37b5458-71ed-47fc-ac7c-17b1bcc926cd None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.247041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b44b1-1131-453b-9340-c1219a1a5a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.247675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b44b1-1131-453b-9340-c1219a1a5a11 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.247951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b44b1-1131-453b-9340-c1219a1a5a11 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.248220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b44b1-1131-453b-9340-c1219a1a5a11 None admin] PATH_INFO: `/v3/users/f6d75742cc3e46a0938c1401ecd82d79` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.261665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b44b1-1131-453b-9340-c1219a1a5a11 None admin] RBAC: Authorizing `identity:get_user(user_id=f6d75742cc3e46a0938c1401ecd82d79)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.263064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710b44b1-1131-453b-9340-c1219a1a5a11 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.264646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 559/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/users/f6d75742cc3e46a0938c1401ecd82d79 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:00.270941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f5a2e-c4a2-4436-a5f5-e37d40eb8c56 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.357381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:00.372608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2f5a2e-c4a2-4436-a5f5-e37d40eb8c56 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.404269 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ddb4-43a5-434e-b6a0-2bba88470104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.404859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ddb4-43a5-434e-b6a0-2bba88470104 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.405142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ddb4-43a5-434e-b6a0-2bba88470104 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.405414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5ddb4-43a5-434e-b6a0-2bba88470104 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.469082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5ddb4-43a5-434e-b6a0-2bba88470104 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.471044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf5ddb4-43a5-434e-b6a0-2bba88470104 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.549052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:00.565154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 585/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:35:00.571103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b44b1-1131-453b-9340-c1219a1a5a11 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.642556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:00.665759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b44b1-1131-453b-9340-c1219a1a5a11 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.698583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39188c-3fbc-4d1c-b1d2-5f758facbb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.699198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39188c-3fbc-4d1c-b1d2-5f758facbb88 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.699475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39188c-3fbc-4d1c-b1d2-5f758facbb88 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.699776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39188c-3fbc-4d1c-b1d2-5f758facbb88 None admin] PATH_INFO: `/v3/projects/71d96881b9e043fc9efab6bca9f665ff` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.700872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39188c-3fbc-4d1c-b1d2-5f758facbb88 None admin] RBAC: Authorizing `identity:get_project(project_id=71d96881b9e043fc9efab6bca9f665ff)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.702356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39188c-3fbc-4d1c-b1d2-5f758facbb88 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.703979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 560/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/projects/71d96881b9e043fc9efab6bca9f665ff => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:00.710123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ddb4-43a5-434e-b6a0-2bba88470104 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:00.804894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf5ddb4-43a5-434e-b6a0-2bba88470104 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:00.840243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56160532-edba-43d6-a0be-5b5b001808d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:00.840833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56160532-edba-43d6-a0be-5b5b001808d4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:00.841112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56160532-edba-43d6-a0be-5b5b001808d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:00.841385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56160532-edba-43d6-a0be-5b5b001808d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:00.842100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56160532-edba-43d6-a0be-5b5b001808d4 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=71d96881b9e043fc9efab6bca9f665ff, user.id=f6d75742cc3e46a0938c1401ecd82d79) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:00.842409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56160532-edba-43d6-a0be-5b5b001808d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:00.843848 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56160532-edba-43d6-a0be-5b5b001808d4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:00.849480 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 586/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:35:00 2022] GET /identity/v3/role_assignments?user.id=f6d75742cc3e46a0938c1401ecd82d79&scope.project.id=71d96881b9e043fc9efab6bca9f665ff&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:02.954875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5ace6-0940-4ada-a794-c79b6a1d7c1a None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:02.955410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5ace6-0940-4ada-a794-c79b6a1d7c1a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:02.955531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5ace6-0940-4ada-a794-c79b6a1d7c1a None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:02.956809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 561/1147] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:02.962041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf5c8b-4b01-40e5-a6be-6ceace63a7fb None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:02.962459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf5c8b-4b01-40e5-a6be-6ceace63a7fb None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:02.962683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf5c8b-4b01-40e5-a6be-6ceace63a7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:02.980797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-35bf5c8b-4b01-40e5-a6be-6ceace63a7fb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:02.981968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-35bf5c8b-4b01-40e5-a6be-6ceace63a7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:03.025233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:03.047349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 587/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:03.312848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5ace6-0940-4ada-a794-c79b6a1d7c1a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.409565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5ace6-0940-4ada-a794-c79b6a1d7c1a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:03.442406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679df85-0112-43ba-9846-eee1bbd71983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:03.443021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679df85-0112-43ba-9846-eee1bbd71983 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.443298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679df85-0112-43ba-9846-eee1bbd71983 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.443597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679df85-0112-43ba-9846-eee1bbd71983 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.453332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0679df85-0112-43ba-9846-eee1bbd71983 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-0679df85-0112-43ba-9846-eee1bbd71983 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:03.458155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:03.459138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:35:03.460274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 562/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:03.465215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf5c8b-4b01-40e5-a6be-6ceace63a7fb None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.559322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf5c8b-4b01-40e5-a6be-6ceace63a7fb None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:03.591490 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae67bba-4d7e-42ad-9971-fd5c7c14209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:03.592050 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae67bba-4d7e-42ad-9971-fd5c7c14209b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.592743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae67bba-4d7e-42ad-9971-fd5c7c14209b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.592743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae67bba-4d7e-42ad-9971-fd5c7c14209b None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.593217 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae67bba-4d7e-42ad-9971-fd5c7c14209b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:03.593514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae67bba-4d7e-42ad-9971-fd5c7c14209b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:03.594864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae67bba-4d7e-42ad-9971-fd5c7c14209b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:03.603178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 588/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:03.609063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679df85-0112-43ba-9846-eee1bbd71983 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.612442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:03.704871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679df85-0112-43ba-9846-eee1bbd71983 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:03.737553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd37451-9cae-4f56-ac92-b44347a3a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:03.738161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37451-9cae-4f56-ac92-b44347a3a77a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.738441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37451-9cae-4f56-ac92-b44347a3a77a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.738731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd37451-9cae-4f56-ac92-b44347a3a77a None admin] PATH_INFO: `/v3/users/f6d75742cc3e46a0938c1401ecd82d79` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.739840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd37451-9cae-4f56-ac92-b44347a3a77a None admin] RBAC: Authorizing `identity:get_user(user_id=f6d75742cc3e46a0938c1401ecd82d79)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:03.741251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd37451-9cae-4f56-ac92-b44347a3a77a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:03.742793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 563/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:03 2022] GET /identity/v3/users/f6d75742cc3e46a0938c1401ecd82d79 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:03.748574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae67bba-4d7e-42ad-9971-fd5c7c14209b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.788088 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:03.842563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae67bba-4d7e-42ad-9971-fd5c7c14209b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:03.875268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8ce72-39c5-43db-a56d-7b7fe2b4cfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:03.875907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8ce72-39c5-43db-a56d-7b7fe2b4cfbf None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:03.876187 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8ce72-39c5-43db-a56d-7b7fe2b4cfbf None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:03.876980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8ce72-39c5-43db-a56d-7b7fe2b4cfbf None admin] PATH_INFO: `/v3/projects/71d96881b9e043fc9efab6bca9f665ff` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:03.878070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8ce72-39c5-43db-a56d-7b7fe2b4cfbf None admin] RBAC: Authorizing `identity:get_project(project_id=71d96881b9e043fc9efab6bca9f665ff)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:03.879476 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8ce72-39c5-43db-a56d-7b7fe2b4cfbf None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:03.881067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 589/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:03 2022] GET /identity/v3/projects/71d96881b9e043fc9efab6bca9f665ff => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:03.886803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd37451-9cae-4f56-ac92-b44347a3a77a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:03.952930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:03.982298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd37451-9cae-4f56-ac92-b44347a3a77a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:04.014709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be20cbfc-24a9-4025-84ee-851f023610f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:04.015349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20cbfc-24a9-4025-84ee-851f023610f9 None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:04.015659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20cbfc-24a9-4025-84ee-851f023610f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:04.015935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be20cbfc-24a9-4025-84ee-851f023610f9 None admin] PATH_INFO: `/v3/projects/71d96881b9e043fc9efab6bca9f665ff/users/f6d75742cc3e46a0938c1401ecd82d79/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:04.017828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20cbfc-24a9-4025-84ee-851f023610f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=71d96881b9e043fc9efab6bca9f665ff, user_id=f6d75742cc3e46a0938c1401ecd82d79, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:04.019245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be20cbfc-24a9-4025-84ee-851f023610f9 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:04.112253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 564/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:35:03 2022] PUT /identity/v3/projects/71d96881b9e043fc9efab6bca9f665ff/users/f6d75742cc3e46a0938c1401ecd82d79/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:06.226991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4681d-3bc3-4251-8b11-56ae36e4700d None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:06.227551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4681d-3bc3-4251-8b11-56ae36e4700d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:06.227646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4681d-3bc3-4251-8b11-56ae36e4700d None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:06.228927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 590/1154] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:35:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:06.234060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3704e-bc86-4d5a-8135-96b861a16ee1 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:06.234441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3704e-bc86-4d5a-8135-96b861a16ee1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:06.234608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f3704e-bc86-4d5a-8135-96b861a16ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:06.252865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-13f3704e-bc86-4d5a-8135-96b861a16ee1 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:06.254039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-13f3704e-bc86-4d5a-8135-96b861a16ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:06.318819 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 565/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:06.589450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4681d-3bc3-4251-8b11-56ae36e4700d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:06.687056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4681d-3bc3-4251-8b11-56ae36e4700d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:06.696343 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:06.719263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21be58-7eeb-42e7-ad4b-b99f9691be34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:06.720101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21be58-7eeb-42e7-ad4b-b99f9691be34 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:06.720398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21be58-7eeb-42e7-ad4b-b99f9691be34 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:06.720676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc21be58-7eeb-42e7-ad4b-b99f9691be34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:06.730231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc21be58-7eeb-42e7-ad4b-b99f9691be34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-cc21be58-7eeb-42e7-ad4b-b99f9691be34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:06.735036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:06.736836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:35:06.737898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 591/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:06.742836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3704e-bc86-4d5a-8135-96b861a16ee1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:06.799013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:06.837767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f3704e-bc86-4d5a-8135-96b861a16ee1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:06.869831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f982cc2-3608-4349-9f7e-f842032b101d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:06.870368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f982cc2-3608-4349-9f7e-f842032b101d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:06.870646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f982cc2-3608-4349-9f7e-f842032b101d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:06.870916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f982cc2-3608-4349-9f7e-f842032b101d None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:06.871599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f982cc2-3608-4349-9f7e-f842032b101d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:06.871902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f982cc2-3608-4349-9f7e-f842032b101d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:06.873270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f982cc2-3608-4349-9f7e-f842032b101d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:06.881547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 566/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:35:06.887501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21be58-7eeb-42e7-ad4b-b99f9691be34 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:06.983675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc21be58-7eeb-42e7-ad4b-b99f9691be34 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:07.016182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9c895-6e1b-4320-b7a8-1ad9a3372f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:07.016794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9c895-6e1b-4320-b7a8-1ad9a3372f82 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:07.017102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9c895-6e1b-4320-b7a8-1ad9a3372f82 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:07.017377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9c895-6e1b-4320-b7a8-1ad9a3372f82 None admin] PATH_INFO: `/v3/users/f6d75742cc3e46a0938c1401ecd82d79` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:07.018491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9c895-6e1b-4320-b7a8-1ad9a3372f82 None admin] RBAC: Authorizing `identity:get_user(user_id=f6d75742cc3e46a0938c1401ecd82d79)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:07.019949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9c895-6e1b-4320-b7a8-1ad9a3372f82 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:07.021479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 592/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:06 2022] GET /identity/v3/users/f6d75742cc3e46a0938c1401ecd82d79 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:07.027212 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f982cc2-3608-4349-9f7e-f842032b101d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:07.123094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f982cc2-3608-4349-9f7e-f842032b101d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:07.143614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:07.154416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfe4a8-f68f-4063-bb4c-a97cbaf21049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:07.155284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe4a8-f68f-4063-bb4c-a97cbaf21049 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:07.155379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe4a8-f68f-4063-bb4c-a97cbaf21049 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:07.155689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe4a8-f68f-4063-bb4c-a97cbaf21049 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:07.218770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfe4a8-f68f-4063-bb4c-a97cbaf21049 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:07.220707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acfe4a8-f68f-4063-bb4c-a97cbaf21049 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:07.312338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 567/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:35:07.318232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9c895-6e1b-4320-b7a8-1ad9a3372f82 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:07.352142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:07.413409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9c895-6e1b-4320-b7a8-1ad9a3372f82 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:07.445080 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11534230-89ba-4485-bb02-80588e2ea616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:07.445689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11534230-89ba-4485-bb02-80588e2ea616 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:07.445967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11534230-89ba-4485-bb02-80588e2ea616 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:07.446240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11534230-89ba-4485-bb02-80588e2ea616 None admin] PATH_INFO: `/v3/projects/71d96881b9e043fc9efab6bca9f665ff` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:07.447332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11534230-89ba-4485-bb02-80588e2ea616 None admin] RBAC: Authorizing `identity:get_project(project_id=71d96881b9e043fc9efab6bca9f665ff)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:07.448769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11534230-89ba-4485-bb02-80588e2ea616 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:07.450328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 593/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:07 2022] GET /identity/v3/projects/71d96881b9e043fc9efab6bca9f665ff => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:07.456817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfe4a8-f68f-4063-bb4c-a97cbaf21049 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:07.479633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:07.551740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfe4a8-f68f-4063-bb4c-a97cbaf21049 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:07.587418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6953dfd-11ad-4d4d-b95d-d60fad48f0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:07.588464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953dfd-11ad-4d4d-b95d-d60fad48f0be None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:07.588744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953dfd-11ad-4d4d-b95d-d60fad48f0be None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:07.589018 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6953dfd-11ad-4d4d-b95d-d60fad48f0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:07.589742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6953dfd-11ad-4d4d-b95d-d60fad48f0be None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=71d96881b9e043fc9efab6bca9f665ff, user.id=f6d75742cc3e46a0938c1401ecd82d79) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:07.590053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6953dfd-11ad-4d4d-b95d-d60fad48f0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:07.591470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6953dfd-11ad-4d4d-b95d-d60fad48f0be None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:07.597141 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 568/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:35:07 2022] GET /identity/v3/role_assignments?user.id=f6d75742cc3e46a0938c1401ecd82d79&scope.project.id=71d96881b9e043fc9efab6bca9f665ff&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:09.741654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1160e4-e9a5-4ed6-b3ff-8a16789eb9db None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:09.742231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1160e4-e9a5-4ed6-b3ff-8a16789eb9db None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:09.742231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1160e4-e9a5-4ed6-b3ff-8a16789eb9db None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:09.743546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 594/1162] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:09.748685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dbfa3-41ad-443c-a2ed-7b084bfa01ce None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:09.749067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dbfa3-41ad-443c-a2ed-7b084bfa01ce None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:09.749235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4dbfa3-41ad-443c-a2ed-7b084bfa01ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:09.767760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-4b4dbfa3-41ad-443c-a2ed-7b084bfa01ce None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:09.768942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4b4dbfa3-41ad-443c-a2ed-7b084bfa01ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:09.833365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 569/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:10.102924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1160e4-e9a5-4ed6-b3ff-8a16789eb9db None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:10.200952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1160e4-e9a5-4ed6-b3ff-8a16789eb9db None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:10.203176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:10.233388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab7025-b68a-43e0-b6cc-0532a835b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:10.233967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab7025-b68a-43e0-b6cc-0532a835b452 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:10.234243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab7025-b68a-43e0-b6cc-0532a835b452 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:10.234512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ab7025-b68a-43e0-b6cc-0532a835b452 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:10.298497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab7025-b68a-43e0-b6cc-0532a835b452 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:10.299943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ab7025-b68a-43e0-b6cc-0532a835b452 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:10.391211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 595/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:35:10.397562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dbfa3-41ad-443c-a2ed-7b084bfa01ce None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:10.414726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:10.492069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4dbfa3-41ad-443c-a2ed-7b084bfa01ce None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:10.524165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e7b896-5c6b-4c91-be5a-1f3a80a84211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:10.524774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7b896-5c6b-4c91-be5a-1f3a80a84211 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:10.525054 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7b896-5c6b-4c91-be5a-1f3a80a84211 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:10.525325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e7b896-5c6b-4c91-be5a-1f3a80a84211 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:10.531700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7b896-5c6b-4c91-be5a-1f3a80a84211 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:10.533719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e7b896-5c6b-4c91-be5a-1f3a80a84211 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-01e7b896-5c6b-4c91-be5a-1f3a80a84211 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:10.544627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:10.545892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:35:10.547024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 570/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:35:10 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:10.552048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab7025-b68a-43e0-b6cc-0532a835b452 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:10.555267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:10.647712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ab7025-b68a-43e0-b6cc-0532a835b452 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:10.679859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e1c7b-e04b-42e7-b218-a83236fc257e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:10.680453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1c7b-e04b-42e7-b218-a83236fc257e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:10.680732 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1c7b-e04b-42e7-b218-a83236fc257e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:10.681005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e1c7b-e04b-42e7-b218-a83236fc257e None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:10.681640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1c7b-e04b-42e7-b218-a83236fc257e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:10.681943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1c7b-e04b-42e7-b218-a83236fc257e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:10.683297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e1c7b-e04b-42e7-b218-a83236fc257e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:10.690648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 596/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Tue Oct 4 08:35:10 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:12.814657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298d356-34b1-429b-a5a1-7d3d5fb5664f None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:12.815193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298d356-34b1-429b-a5a1-7d3d5fb5664f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:12.815290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298d356-34b1-429b-a5a1-7d3d5fb5664f None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:12.816666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 571/1167] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:12.821959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7713e08-7190-42a8-9ec2-f7629bd052fb None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:12.822375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7713e08-7190-42a8-9ec2-f7629bd052fb None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:12.822508 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7713e08-7190-42a8-9ec2-f7629bd052fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:12.840672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f7713e08-7190-42a8-9ec2-f7629bd052fb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:12.841847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f7713e08-7190-42a8-9ec2-f7629bd052fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:12.900284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:12.905372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 597/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:13.171493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298d356-34b1-429b-a5a1-7d3d5fb5664f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:13.246207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:13.269706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298d356-34b1-429b-a5a1-7d3d5fb5664f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:13.301632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262733e-7d68-4a0b-a9aa-88062a7d89ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:13.302214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262733e-7d68-4a0b-a9aa-88062a7d89ca None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:13.302490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262733e-7d68-4a0b-a9aa-88062a7d89ca None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:13.302758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262733e-7d68-4a0b-a9aa-88062a7d89ca None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:13.303702 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262733e-7d68-4a0b-a9aa-88062a7d89ca None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:13.305035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b262733e-7d68-4a0b-a9aa-88062a7d89ca None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:13.401006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 572/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Tue Oct 4 08:35:13 2022] POST /identity/v3/domains => generated 267 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:15.542800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4a0a-dbd2-44e6-a6ae-d99b89b6fcdf None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:15.543352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4a0a-dbd2-44e6-a6ae-d99b89b6fcdf None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:15.543352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e4a0a-dbd2-44e6-a6ae-d99b89b6fcdf None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:15.544713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 598/1170] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:15.550391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25484a-a3d6-4420-85ab-471bd3d6b93a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:15.550770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25484a-a3d6-4420-85ab-471bd3d6b93a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:15.550951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25484a-a3d6-4420-85ab-471bd3d6b93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:15.569602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-2c25484a-a3d6-4420-85ab-471bd3d6b93a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:15.570803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2c25484a-a3d6-4420-85ab-471bd3d6b93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:15.634993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 573/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 04 08:35:15.909399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4a0a-dbd2-44e6-a6ae-d99b89b6fcdf None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:16.011166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e4a0a-dbd2-44e6-a6ae-d99b89b6fcdf None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:16.044299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b57431-cd60-4d9e-99f0-e623a6c49e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:16.044910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b57431-cd60-4d9e-99f0-e623a6c49e6c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:16.045195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b57431-cd60-4d9e-99f0-e623a6c49e6c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:16.045471 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b57431-cd60-4d9e-99f0-e623a6c49e6c None admin] PATH_INFO: `/v3/domains/4f3301ecd6ab4f10bf9df6ab1a9901f6` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:16.056333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b57431-cd60-4d9e-99f0-e623a6c49e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=4f3301ecd6ab4f10bf9df6ab1a9901f6)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:16.057772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b57431-cd60-4d9e-99f0-e623a6c49e6c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:16.059319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 599/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Oct 4 08:35:15 2022] GET /identity/v3/domains/4f3301ecd6ab4f10bf9df6ab1a9901f6 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:16.065147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25484a-a3d6-4420-85ab-471bd3d6b93a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:16.127563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:16.160515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25484a-a3d6-4420-85ab-471bd3d6b93a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:16.193396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8345ffe-a972-4a1f-b19c-600f5c9b67d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:16.193992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8345ffe-a972-4a1f-b19c-600f5c9b67d3 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:16.194273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8345ffe-a972-4a1f-b19c-600f5c9b67d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:16.194550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8345ffe-a972-4a1f-b19c-600f5c9b67d3 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:16.195224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8345ffe-a972-4a1f-b19c-600f5c9b67d3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:16.196661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8345ffe-a972-4a1f-b19c-600f5c9b67d3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:16.295664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 574/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:35:16 2022] POST /identity/v3/projects => generated 361 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:18.458877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4b86b-58c5-414d-a1b0-689dbf197835 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.459435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4b86b-58c5-414d-a1b0-689dbf197835 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.459435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4b86b-58c5-414d-a1b0-689dbf197835 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.460755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 600/1174] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:18.466128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0d53-9f50-4df9-b21e-83f8f8b19264 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.466534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0d53-9f50-4df9-b21e-83f8f8b19264 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.466685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0d53-9f50-4df9-b21e-83f8f8b19264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.484498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-dfca0d53-9f50-4df9-b21e-83f8f8b19264 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:18.485711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-dfca0d53-9f50-4df9-b21e-83f8f8b19264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:18.550444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 575/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:18.818844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4b86b-58c5-414d-a1b0-689dbf197835 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:18.875785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:18.916209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4b86b-58c5-414d-a1b0-689dbf197835 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:18.948430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2881079a-6f3d-4ba2-ad33-3ad08de6e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:18.949040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881079a-6f3d-4ba2-ad33-3ad08de6e214 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:18.949320 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881079a-6f3d-4ba2-ad33-3ad08de6e214 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:18.949592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2881079a-6f3d-4ba2-ad33-3ad08de6e214 None admin] PATH_INFO: `/v3/domains/4f3301ecd6ab4f10bf9df6ab1a9901f6` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:18.950694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881079a-6f3d-4ba2-ad33-3ad08de6e214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4f3301ecd6ab4f10bf9df6ab1a9901f6)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:18.952174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2881079a-6f3d-4ba2-ad33-3ad08de6e214 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:18.953701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 601/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Tue Oct 4 08:35:18 2022] GET /identity/v3/domains/4f3301ecd6ab4f10bf9df6ab1a9901f6 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:18.959865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca0d53-9f50-4df9-b21e-83f8f8b19264 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:19.005468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:19.052881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca0d53-9f50-4df9-b21e-83f8f8b19264 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:19.086035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3b7382-6fae-43eb-a33b-787867917265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:19.086568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b7382-6fae-43eb-a33b-787867917265 None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:19.086843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b7382-6fae-43eb-a33b-787867917265 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:19.087111 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3b7382-6fae-43eb-a33b-787867917265 None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:19.087793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b7382-6fae-43eb-a33b-787867917265 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:19.089204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3b7382-6fae-43eb-a33b-787867917265 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:19.188236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 576/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:35:18 2022] POST /identity/v3/users => generated 311 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:35:21.353447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3188e28-2e21-47ff-a35a-72bdcdb73cf2 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.354030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3188e28-2e21-47ff-a35a-72bdcdb73cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.354030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3188e28-2e21-47ff-a35a-72bdcdb73cf2 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.355323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 602/1178] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:21.360532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5704b-32ec-4f24-a88c-62fa2d09f522 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.361498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5704b-32ec-4f24-a88c-62fa2d09f522 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.361695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5704b-32ec-4f24-a88c-62fa2d09f522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.379187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-dca5704b-32ec-4f24-a88c-62fa2d09f522 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:21.380379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-dca5704b-32ec-4f24-a88c-62fa2d09f522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:21.444114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 577/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:21.712989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3188e28-2e21-47ff-a35a-72bdcdb73cf2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.811500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3188e28-2e21-47ff-a35a-72bdcdb73cf2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:21.836675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:21.845042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db0f46-b9d5-4074-92f9-05c6db2b325c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:21.845664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db0f46-b9d5-4074-92f9-05c6db2b325c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:21.845945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db0f46-b9d5-4074-92f9-05c6db2b325c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:21.846219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4db0f46-b9d5-4074-92f9-05c6db2b325c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:21.856060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4db0f46-b9d5-4074-92f9-05c6db2b325c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-b4db0f46-b9d5-4074-92f9-05c6db2b325c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:21.861437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:21.866366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:35:21.867485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 603/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:21.868693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5704b-32ec-4f24-a88c-62fa2d09f522 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:21.900726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:21.963571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5704b-32ec-4f24-a88c-62fa2d09f522 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.000966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd00e63-761b-4fed-ab42-77801b35712d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.001595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd00e63-761b-4fed-ab42-77801b35712d None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.001876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd00e63-761b-4fed-ab42-77801b35712d None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.002149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd00e63-761b-4fed-ab42-77801b35712d None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.002837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd00e63-761b-4fed-ab42-77801b35712d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:22.003141 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd00e63-761b-4fed-ab42-77801b35712d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.004529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd00e63-761b-4fed-ab42-77801b35712d None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.012210 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 578/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:22.018122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db0f46-b9d5-4074-92f9-05c6db2b325c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.114772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4db0f46-b9d5-4074-92f9-05c6db2b325c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.146989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6618b-7a26-4002-b6ab-814a41d4e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.147630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6618b-7a26-4002-b6ab-814a41d4e7ca None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.147925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6618b-7a26-4002-b6ab-814a41d4e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.148202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c6618b-7a26-4002-b6ab-814a41d4e7ca None admin] PATH_INFO: `/v3/users/a1e22f36671646cba4a00aeda1a323e2` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.161161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6618b-7a26-4002-b6ab-814a41d4e7ca None admin] RBAC: Authorizing `identity:get_user(user_id=a1e22f36671646cba4a00aeda1a323e2)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.162587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c6618b-7a26-4002-b6ab-814a41d4e7ca None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.164175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 604/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/users/a1e22f36671646cba4a00aeda1a323e2 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:22.169773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd00e63-761b-4fed-ab42-77801b35712d None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.259319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:22.264798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd00e63-761b-4fed-ab42-77801b35712d None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.297411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6190-cc05-44ef-87e8-af30223db606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.297996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6190-cc05-44ef-87e8-af30223db606 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.298297 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6190-cc05-44ef-87e8-af30223db606 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.298568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c6190-cc05-44ef-87e8-af30223db606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.361391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c6190-cc05-44ef-87e8-af30223db606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.362808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c6190-cc05-44ef-87e8-af30223db606 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.448659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:22.455209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 579/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:35:22.461145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6618b-7a26-4002-b6ab-814a41d4e7ca None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.504610 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:22.556558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c6618b-7a26-4002-b6ab-814a41d4e7ca None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.591176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbccd1b-499d-4500-a32b-2cf877ad2049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.591965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbccd1b-499d-4500-a32b-2cf877ad2049 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.592607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbccd1b-499d-4500-a32b-2cf877ad2049 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.592607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbccd1b-499d-4500-a32b-2cf877ad2049 None admin] PATH_INFO: `/v3/projects/5db0f33c320e4c98a09e6a6b117953f0` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.593605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbccd1b-499d-4500-a32b-2cf877ad2049 None admin] RBAC: Authorizing `identity:get_project(project_id=5db0f33c320e4c98a09e6a6b117953f0)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.595640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbccd1b-499d-4500-a32b-2cf877ad2049 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.597248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 605/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/projects/5db0f33c320e4c98a09e6a6b117953f0 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:22.603226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6190-cc05-44ef-87e8-af30223db606 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:22.696184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c6190-cc05-44ef-87e8-af30223db606 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:22.728194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24bce8d-d384-4af9-bd4a-8e5e2657d2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:22.728773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bce8d-d384-4af9-bd4a-8e5e2657d2d8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:22.729052 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bce8d-d384-4af9-bd4a-8e5e2657d2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:22.729320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24bce8d-d384-4af9-bd4a-8e5e2657d2d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:22.730032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bce8d-d384-4af9-bd4a-8e5e2657d2d8 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=5db0f33c320e4c98a09e6a6b117953f0, user.id=a1e22f36671646cba4a00aeda1a323e2) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:22.730335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bce8d-d384-4af9-bd4a-8e5e2657d2d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:22.731768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24bce8d-d384-4af9-bd4a-8e5e2657d2d8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:22.736897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 580/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:35:22 2022] GET /identity/v3/role_assignments?user.id=a1e22f36671646cba4a00aeda1a323e2&scope.project.id=5db0f33c320e4c98a09e6a6b117953f0&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 259 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:24.808652 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc775c-08a1-43a9-bba8-b483f8120794 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:24.809184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc775c-08a1-43a9-bba8-b483f8120794 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:24.809184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc775c-08a1-43a9-bba8-b483f8120794 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:24.810512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 606/1186] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:24.815797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f1007-e754-4f31-97e1-47531f0f09c6 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:24.816202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f1007-e754-4f31-97e1-47531f0f09c6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:24.816349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f1007-e754-4f31-97e1-47531f0f09c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:24.834490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-0b9f1007-e754-4f31-97e1-47531f0f09c6 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:24.835713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0b9f1007-e754-4f31-97e1-47531f0f09c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:24.887916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:24.898852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 581/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:25.162817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc775c-08a1-43a9-bba8-b483f8120794 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:25.260166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc775c-08a1-43a9-bba8-b483f8120794 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:25.272991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:25.292254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0138f-3b2a-498b-bb32-8e3d5e789081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:25.292859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0138f-3b2a-498b-bb32-8e3d5e789081 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:25.293135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0138f-3b2a-498b-bb32-8e3d5e789081 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:25.293401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc0138f-3b2a-498b-bb32-8e3d5e789081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.304131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc0138f-3b2a-498b-bb32-8e3d5e789081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-5bc0138f-3b2a-498b-bb32-8e3d5e789081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:25.309165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:25.310239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:35:25.311094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 607/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:25.316872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f1007-e754-4f31-97e1-47531f0f09c6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:25.409970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f1007-e754-4f31-97e1-47531f0f09c6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:25.442752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ec3c-59cf-4e8f-903e-64ff0adcde98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:25.443346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ec3c-59cf-4e8f-903e-64ff0adcde98 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:25.443654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ec3c-59cf-4e8f-903e-64ff0adcde98 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:25.443931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41ec3c-59cf-4e8f-903e-64ff0adcde98 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.444593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ec3c-59cf-4e8f-903e-64ff0adcde98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:25.444897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ec3c-59cf-4e8f-903e-64ff0adcde98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:25.446239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41ec3c-59cf-4e8f-903e-64ff0adcde98 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:25.453878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 582/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:25.459694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0138f-3b2a-498b-bb32-8e3d5e789081 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:25.555200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc0138f-3b2a-498b-bb32-8e3d5e789081 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:25.588098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c245b69-d36e-4ed9-bdef-c717cb3b98c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:25.588719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c245b69-d36e-4ed9-bdef-c717cb3b98c0 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:25.589001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c245b69-d36e-4ed9-bdef-c717cb3b98c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:25.589274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c245b69-d36e-4ed9-bdef-c717cb3b98c0 None admin] PATH_INFO: `/v3/users/a1e22f36671646cba4a00aeda1a323e2` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.590393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c245b69-d36e-4ed9-bdef-c717cb3b98c0 None admin] RBAC: Authorizing `identity:get_user(user_id=a1e22f36671646cba4a00aeda1a323e2)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:25.591852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c245b69-d36e-4ed9-bdef-c717cb3b98c0 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:25.593400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 608/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:25 2022] GET /identity/v3/users/a1e22f36671646cba4a00aeda1a323e2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:25.599022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ec3c-59cf-4e8f-903e-64ff0adcde98 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:25.649622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:25.694603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41ec3c-59cf-4e8f-903e-64ff0adcde98 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:25.726273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dadf75-596d-4fd6-9788-777c8047a7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:25.726887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadf75-596d-4fd6-9788-777c8047a7c8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:25.727168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadf75-596d-4fd6-9788-777c8047a7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:25.727440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dadf75-596d-4fd6-9788-777c8047a7c8 None admin] PATH_INFO: `/v3/projects/5db0f33c320e4c98a09e6a6b117953f0` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.728567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dadf75-596d-4fd6-9788-777c8047a7c8 None admin] RBAC: Authorizing `identity:get_project(project_id=5db0f33c320e4c98a09e6a6b117953f0)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:25.729995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dadf75-596d-4fd6-9788-777c8047a7c8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:25.731615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 583/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:25 2022] GET /identity/v3/projects/5db0f33c320e4c98a09e6a6b117953f0 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:25.737864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c245b69-d36e-4ed9-bdef-c717cb3b98c0 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:25.777338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:25.832765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c245b69-d36e-4ed9-bdef-c717cb3b98c0 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:25.865383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228acd2-9ad1-4d33-81db-5cab955c6063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:25.866015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228acd2-9ad1-4d33-81db-5cab955c6063 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:25.866296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228acd2-9ad1-4d33-81db-5cab955c6063 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:25.866569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228acd2-9ad1-4d33-81db-5cab955c6063 None admin] PATH_INFO: `/v3/projects/5db0f33c320e4c98a09e6a6b117953f0/users/a1e22f36671646cba4a00aeda1a323e2/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:25.868460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228acd2-9ad1-4d33-81db-5cab955c6063 None admin] RBAC: Authorizing `identity:create_grant(project_id=5db0f33c320e4c98a09e6a6b117953f0, user_id=a1e22f36671646cba4a00aeda1a323e2, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:25.869876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228acd2-9ad1-4d33-81db-5cab955c6063 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:25.940428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 609/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:35:25 2022] PUT /identity/v3/projects/5db0f33c320e4c98a09e6a6b117953f0/users/a1e22f36671646cba4a00aeda1a323e2/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:35:28.043868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e3b3-f378-487d-b768-c6ed306af8bb None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.044420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e3b3-f378-487d-b768-c6ed306af8bb None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.044420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f84e3b3-f378-487d-b768-c6ed306af8bb None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:28.045745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 584/1193] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:35:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:35:28.051659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c7b1-9d9a-4711-a34f-f146c73fedb2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.052093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c7b1-9d9a-4711-a34f-f146c73fedb2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.052202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9c7b1-9d9a-4711-a34f-f146c73fedb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:28.070052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-66e9c7b1-9d9a-4711-a34f-f146c73fedb2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:35:28.071228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-66e9c7b1-9d9a-4711-a34f-f146c73fedb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:35:28.134362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 610/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:35:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:35:28.403817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e3b3-f378-487d-b768-c6ed306af8bb None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:28.501527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f84e3b3-f378-487d-b768-c6ed306af8bb None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:28.521411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:28.535216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1ca7d-53ff-48c9-9f86-18b900883f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:28.539767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1ca7d-53ff-48c9-9f86-18b900883f2c None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.539767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1ca7d-53ff-48c9-9f86-18b900883f2c None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.539767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1ca7d-53ff-48c9-9f86-18b900883f2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:28.545896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1ca7d-53ff-48c9-9f86-18b900883f2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-cde1ca7d-53ff-48c9-9f86-18b900883f2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:35:28.550603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:35:28.551783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:35:28.552641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 585/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:35:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:35:28.557967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c7b1-9d9a-4711-a34f-f146c73fedb2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:28.586512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:28.652553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9c7b1-9d9a-4711-a34f-f146c73fedb2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:28.685718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae5b8f-c13d-4a27-bb5f-f7fb6c97f721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:28.686256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5b8f-c13d-4a27-bb5f-f7fb6c97f721 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.686537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5b8f-c13d-4a27-bb5f-f7fb6c97f721 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.686810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ae5b8f-c13d-4a27-bb5f-f7fb6c97f721 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:28.687470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae5b8f-c13d-4a27-bb5f-f7fb6c97f721 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:28.687805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae5b8f-c13d-4a27-bb5f-f7fb6c97f721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:28.689726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ae5b8f-c13d-4a27-bb5f-f7fb6c97f721 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:28.697355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 611/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:28.703383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1ca7d-53ff-48c9-9f86-18b900883f2c None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:28.797861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1ca7d-53ff-48c9-9f86-18b900883f2c None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:28.832082 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85db91-3899-48de-80a1-9752f0fd45b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:28.832691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85db91-3899-48de-80a1-9752f0fd45b8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.832969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85db91-3899-48de-80a1-9752f0fd45b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.833240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85db91-3899-48de-80a1-9752f0fd45b8 None admin] PATH_INFO: `/v3/users/a1e22f36671646cba4a00aeda1a323e2` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:28.834344 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85db91-3899-48de-80a1-9752f0fd45b8 None admin] RBAC: Authorizing `identity:get_user(user_id=a1e22f36671646cba4a00aeda1a323e2)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:28.835786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a85db91-3899-48de-80a1-9752f0fd45b8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:28.837349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 586/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Tue Oct 4 08:35:28 2022] GET /identity/v3/users/a1e22f36671646cba4a00aeda1a323e2 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:28.843087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae5b8f-c13d-4a27-bb5f-f7fb6c97f721 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:28.931238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:28.944118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ae5b8f-c13d-4a27-bb5f-f7fb6c97f721 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:28.973053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e96f-7797-4f9d-b312-18ace4536f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:28.973657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e96f-7797-4f9d-b312-18ace4536f5b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:28.973936 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e96f-7797-4f9d-b312-18ace4536f5b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:28.974208 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a5e96f-7797-4f9d-b312-18ace4536f5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.037793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e96f-7797-4f9d-b312-18ace4536f5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:29.039224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a5e96f-7797-4f9d-b312-18ace4536f5b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:29.123655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:29.133093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 612/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:35:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:35:29.139552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85db91-3899-48de-80a1-9752f0fd45b8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:29.186054 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:29.235292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85db91-3899-48de-80a1-9752f0fd45b8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:29.267687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3979de34-f504-403e-ad65-648abd4ed943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:29.268303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979de34-f504-403e-ad65-648abd4ed943 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.268584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979de34-f504-403e-ad65-648abd4ed943 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.268860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3979de34-f504-403e-ad65-648abd4ed943 None admin] PATH_INFO: `/v3/projects/5db0f33c320e4c98a09e6a6b117953f0` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.269973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979de34-f504-403e-ad65-648abd4ed943 None admin] RBAC: Authorizing `identity:get_project(project_id=5db0f33c320e4c98a09e6a6b117953f0)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:29.271383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3979de34-f504-403e-ad65-648abd4ed943 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:29.273020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 587/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Tue Oct 4 08:35:29 2022] GET /identity/v3/projects/5db0f33c320e4c98a09e6a6b117953f0 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:29.278973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e96f-7797-4f9d-b312-18ace4536f5b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:35:29.373485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a5e96f-7797-4f9d-b312-18ace4536f5b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:35:29.405855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c08080-e091-4060-81a4-8f83526410fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:35:29.406444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c08080-e091-4060-81a4-8f83526410fd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:35:29.406725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c08080-e091-4060-81a4-8f83526410fd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:35:29.407000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c08080-e091-4060-81a4-8f83526410fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:35:29.408261 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c08080-e091-4060-81a4-8f83526410fd None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=5db0f33c320e4c98a09e6a6b117953f0, user.id=a1e22f36671646cba4a00aeda1a323e2) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:35:29.408570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c08080-e091-4060-81a4-8f83526410fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:35:29.409984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c08080-e091-4060-81a4-8f83526410fd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:35:29.415454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 613/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:35:29 2022] GET /identity/v3/role_assignments?user.id=a1e22f36671646cba4a00aeda1a323e2&scope.project.id=5db0f33c320e4c98a09e6a6b117953f0&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:35:39.263620 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=42 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:35:39.413007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=72 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:41.842816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca223fa-9f28-4fa9-937f-0a7b0292cef3 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:41.843395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca223fa-9f28-4fa9-937f-0a7b0292cef3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:41.843395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca223fa-9f28-4fa9-937f-0a7b0292cef3 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:41.844647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 588/1201] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:36:41.849809 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac26cf-b998-4447-90ae-fd6d01d73807 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:41.850229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac26cf-b998-4447-90ae-fd6d01d73807 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:41.850368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ac26cf-b998-4447-90ae-fd6d01d73807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:41.868785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-88ac26cf-b998-4447-90ae-fd6d01d73807 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:41.872653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-88ac26cf-b998-4447-90ae-fd6d01d73807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:41.934637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 614/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:36:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:36:42.213722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca223fa-9f28-4fa9-937f-0a7b0292cef3 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:42.313969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca223fa-9f28-4fa9-937f-0a7b0292cef3 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:42.347244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960133a0-83a5-42e7-8faa-70306180a868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:42.347899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960133a0-83a5-42e7-8faa-70306180a868 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:42.348165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960133a0-83a5-42e7-8faa-70306180a868 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:42.348433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960133a0-83a5-42e7-8faa-70306180a868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:42.358172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960133a0-83a5-42e7-8faa-70306180a868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:42.360643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960133a0-83a5-42e7-8faa-70306180a868 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-960133a0-83a5-42e7-8faa-70306180a868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:42.373533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:42.374727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:42.375757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:42.375757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:42.375757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:36:42.375757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 589/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:42.380802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac26cf-b998-4447-90ae-fd6d01d73807 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:42.476977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ac26cf-b998-4447-90ae-fd6d01d73807 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:42.505231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:42.511388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a3c6d3-3374-4d21-a2a5-474527edf775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:42.512016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3c6d3-3374-4d21-a2a5-474527edf775 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:42.512296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3c6d3-3374-4d21-a2a5-474527edf775 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:42.512567 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a3c6d3-3374-4d21-a2a5-474527edf775 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:42.513227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3c6d3-3374-4d21-a2a5-474527edf775 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:42.513497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3c6d3-3374-4d21-a2a5-474527edf775 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:42.514895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a3c6d3-3374-4d21-a2a5-474527edf775 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:42.525680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 615/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:42.531538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960133a0-83a5-42e7-8faa-70306180a868 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:42.584781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:42.630375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960133a0-83a5-42e7-8faa-70306180a868 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:42.663423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ccee9-b7c3-4f60-91db-13b10b4336ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:42.664046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ccee9-b7c3-4f60-91db-13b10b4336ee None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:42.664324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ccee9-b7c3-4f60-91db-13b10b4336ee None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:42.664599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ccee9-b7c3-4f60-91db-13b10b4336ee None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:42.665255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ccee9-b7c3-4f60-91db-13b10b4336ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:42.666669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006ccee9-b7c3-4f60-91db-13b10b4336ee None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:42.763584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 590/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Tue Oct 4 08:36:42 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:36:44.930600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653b8e-89ee-446b-b2fa-dfa55ed0e7e5 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:44.931127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653b8e-89ee-446b-b2fa-dfa55ed0e7e5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:44.931127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58653b8e-89ee-446b-b2fa-dfa55ed0e7e5 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:44.932434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 616/1206] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:36:44.937898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9df89-7789-411f-a193-b8cf1bdc4061 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:44.938285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9df89-7789-411f-a193-b8cf1bdc4061 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:44.938444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9df89-7789-411f-a193-b8cf1bdc4061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:44.957114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-57e9df89-7789-411f-a193-b8cf1bdc4061 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:44.958327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-57e9df89-7789-411f-a193-b8cf1bdc4061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:45.023130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 591/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:36:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:36:45.292056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653b8e-89ee-446b-b2fa-dfa55ed0e7e5 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:45.390880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58653b8e-89ee-446b-b2fa-dfa55ed0e7e5 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:45.423997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3140b-0cab-4fea-abb9-3800548e621a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:45.424617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3140b-0cab-4fea-abb9-3800548e621a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:45.424893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3140b-0cab-4fea-abb9-3800548e621a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:45.425160 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a3140b-0cab-4fea-abb9-3800548e621a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:45.435608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a3140b-0cab-4fea-abb9-3800548e621a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-66a3140b-0cab-4fea-abb9-3800548e621a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:36:45.440264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:45.443699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:45.444816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 617/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:36:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:45.447986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9df89-7789-411f-a193-b8cf1bdc4061 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:45.485566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:45.542142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9df89-7789-411f-a193-b8cf1bdc4061 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:45.574866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dd1c9-2732-4d32-981e-53114aca6b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:45.575669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dd1c9-2732-4d32-981e-53114aca6b7e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:45.576376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dd1c9-2732-4d32-981e-53114aca6b7e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:45.576661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33dd1c9-2732-4d32-981e-53114aca6b7e None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:45.577336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dd1c9-2732-4d32-981e-53114aca6b7e None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:45.577628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dd1c9-2732-4d32-981e-53114aca6b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:45.578984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33dd1c9-2732-4d32-981e-53114aca6b7e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:45.586894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 592/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:36:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:45.593136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3140b-0cab-4fea-abb9-3800548e621a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:45.642998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:45.691774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a3140b-0cab-4fea-abb9-3800548e621a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:45.725145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800efa1-0620-400e-84fb-ce33deb0a91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:45.725765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800efa1-0620-400e-84fb-ce33deb0a91e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:45.726045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800efa1-0620-400e-84fb-ce33deb0a91e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:45.726315 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2800efa1-0620-400e-84fb-ce33deb0a91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:45.736632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800efa1-0620-400e-84fb-ce33deb0a91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:45.738059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2800efa1-0620-400e-84fb-ce33deb0a91e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-2800efa1-0620-400e-84fb-ce33deb0a91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:45.752593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:45.753717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:45.754839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:45.754839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:45.754839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:45.754839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 618/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:45.760200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dd1c9-2732-4d32-981e-53114aca6b7e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:45.856452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:45.859316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33dd1c9-2732-4d32-981e-53114aca6b7e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:45.892261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee277c-749d-4dd1-917e-4232ffeb3e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:45.892867 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee277c-749d-4dd1-917e-4232ffeb3e43 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:45.893151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee277c-749d-4dd1-917e-4232ffeb3e43 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:45.893515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ee277c-749d-4dd1-917e-4232ffeb3e43 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:45.894163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee277c-749d-4dd1-917e-4232ffeb3e43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:45.894469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee277c-749d-4dd1-917e-4232ffeb3e43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:45.895966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ee277c-749d-4dd1-917e-4232ffeb3e43 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:45.906854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 593/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:45.912691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800efa1-0620-400e-84fb-ce33deb0a91e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:46.009688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2800efa1-0620-400e-84fb-ce33deb0a91e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:46.011186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:46.042412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcc9c4-da76-4581-ad20-0deb91ab5118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:46.044398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcc9c4-da76-4581-ad20-0deb91ab5118 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.044398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcc9c4-da76-4581-ad20-0deb91ab5118 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.044398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dcc9c4-da76-4581-ad20-0deb91ab5118 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.050361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcc9c4-da76-4581-ad20-0deb91ab5118 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:46.051807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dcc9c4-da76-4581-ad20-0deb91ab5118 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-90dcc9c4-da76-4581-ad20-0deb91ab5118 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:36:46.064406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:46.068456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:46.069693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 619/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:36:46.071394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee277c-749d-4dd1-917e-4232ffeb3e43 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:46.170430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ee277c-749d-4dd1-917e-4232ffeb3e43 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:46.202563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6c70f-b485-4096-937b-a0020910b2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:46.203155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6c70f-b485-4096-937b-a0020910b2aa None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.203429 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6c70f-b485-4096-937b-a0020910b2aa None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.203726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6c70f-b485-4096-937b-a0020910b2aa None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.204443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6c70f-b485-4096-937b-a0020910b2aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:46.204751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6c70f-b485-4096-937b-a0020910b2aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:46.206148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6c70f-b485-4096-937b-a0020910b2aa None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:46.226080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 594/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 08:36:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:46.233520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcc9c4-da76-4581-ad20-0deb91ab5118 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:46.329967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dcc9c4-da76-4581-ad20-0deb91ab5118 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:46.362599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83146a56-bc4f-4c8f-80e4-3753fe10cf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:46.363182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83146a56-bc4f-4c8f-80e4-3753fe10cf68 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.363458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83146a56-bc4f-4c8f-80e4-3753fe10cf68 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.363753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83146a56-bc4f-4c8f-80e4-3753fe10cf68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.391491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:46.427863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83146a56-bc4f-4c8f-80e4-3753fe10cf68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:46.429223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83146a56-bc4f-4c8f-80e4-3753fe10cf68 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:46.523979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 620/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:36:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:36:46.530397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6c70f-b485-4096-937b-a0020910b2aa None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:46.549280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:46.628931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6c70f-b485-4096-937b-a0020910b2aa None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:46.661844 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c7e9a-e547-4f11-a2b3-87f34c03add7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:46.662465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7e9a-e547-4f11-a2b3-87f34c03add7 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.662743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7e9a-e547-4f11-a2b3-87f34c03add7 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.663014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c7e9a-e547-4f11-a2b3-87f34c03add7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.672596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c7e9a-e547-4f11-a2b3-87f34c03add7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:46.674012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c7e9a-e547-4f11-a2b3-87f34c03add7 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-983c7e9a-e547-4f11-a2b3-87f34c03add7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:46.689062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:46.690184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:46.691156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:46.691156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:46.691156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:36:46.691156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 595/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:46.696637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83146a56-bc4f-4c8f-80e4-3753fe10cf68 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:46.755341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:46.792826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83146a56-bc4f-4c8f-80e4-3753fe10cf68 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:46.826722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46776b7-082d-48bd-ad9e-362cadc0da4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:46.827322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46776b7-082d-48bd-ad9e-362cadc0da4a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.827630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46776b7-082d-48bd-ad9e-362cadc0da4a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.827904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46776b7-082d-48bd-ad9e-362cadc0da4a None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.828540 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46776b7-082d-48bd-ad9e-362cadc0da4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:46.828843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46776b7-082d-48bd-ad9e-362cadc0da4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:46.830202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46776b7-082d-48bd-ad9e-362cadc0da4a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:46.841992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 621/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:46.847698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c7e9a-e547-4f11-a2b3-87f34c03add7 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:46.916091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:46.949326 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c7e9a-e547-4f11-a2b3-87f34c03add7 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:46.979025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699600-6fc6-41d8-8eee-93624ed5ce49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:46.979678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699600-6fc6-41d8-8eee-93624ed5ce49 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:46.979970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699600-6fc6-41d8-8eee-93624ed5ce49 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:46.980237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c699600-6fc6-41d8-8eee-93624ed5ce49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:46.986657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c699600-6fc6-41d8-8eee-93624ed5ce49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:46.988104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c699600-6fc6-41d8-8eee-93624ed5ce49 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-8c699600-6fc6-41d8-8eee-93624ed5ce49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:36:47.000530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:47.001616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:47.002535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:36:47.002535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:36:47.002535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:36:47.002535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:36:47.002535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:36:47.002535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:36:47.002535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:36:47.002535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:36:47.002535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 596/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:47.007762 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46776b7-082d-48bd-ad9e-362cadc0da4a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:47.105523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46776b7-082d-48bd-ad9e-362cadc0da4a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:47.128085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:47.139660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6436ecbb-d360-4336-a703-8e6f4d3129bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:47.140258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ecbb-d360-4336-a703-8e6f4d3129bc None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:47.140540 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ecbb-d360-4336-a703-8e6f4d3129bc None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:47.140812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6436ecbb-d360-4336-a703-8e6f4d3129bc None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:47.141500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436ecbb-d360-4336-a703-8e6f4d3129bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:47.141804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436ecbb-d360-4336-a703-8e6f4d3129bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:47.143226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6436ecbb-d360-4336-a703-8e6f4d3129bc None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:47.154136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 622/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:47.160206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699600-6fc6-41d8-8eee-93624ed5ce49 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:47.256481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c699600-6fc6-41d8-8eee-93624ed5ce49 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:47.283884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:47.289290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e834c0-34bd-4a2b-b3ea-ea64ade091c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:47.289899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e834c0-34bd-4a2b-b3ea-ea64ade091c4 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:47.290176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e834c0-34bd-4a2b-b3ea-ea64ade091c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:47.290449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e834c0-34bd-4a2b-b3ea-ea64ade091c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:47.291169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e834c0-34bd-4a2b-b3ea-ea64ade091c4 None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=22aa2b6e4b854de4868b75cc9626b8e5) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:47.291477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e834c0-34bd-4a2b-b3ea-ea64ade091c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:47.292933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e834c0-34bd-4a2b-b3ea-ea64ade091c4 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:47.298184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 597/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:36:47 2022] GET /identity/v3/role_assignments?user.id=22aa2b6e4b854de4868b75cc9626b8e5&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:49.428418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88850c2-3bf4-4874-ac8d-bbfad85d09a6 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:49.428981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88850c2-3bf4-4874-ac8d-bbfad85d09a6 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:49.428981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88850c2-3bf4-4874-ac8d-bbfad85d09a6 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:49.430292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 623/1220] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:36:49.435659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15ca9d-4c36-45fc-a2fe-3bf9e4adce3c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:49.436085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15ca9d-4c36-45fc-a2fe-3bf9e4adce3c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:49.436215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15ca9d-4c36-45fc-a2fe-3bf9e4adce3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:49.454148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8e15ca9d-4c36-45fc-a2fe-3bf9e4adce3c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:49.455346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8e15ca9d-4c36-45fc-a2fe-3bf9e4adce3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:49.520216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 598/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:36:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:36:49.797603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88850c2-3bf4-4874-ac8d-bbfad85d09a6 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:49.898813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88850c2-3bf4-4874-ac8d-bbfad85d09a6 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:49.932467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216167f5-f1c0-4c76-bdfd-b1e06a80a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:49.933104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216167f5-f1c0-4c76-bdfd-b1e06a80a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:49.933373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216167f5-f1c0-4c76-bdfd-b1e06a80a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:49.933641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216167f5-f1c0-4c76-bdfd-b1e06a80a9a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:49.943873 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216167f5-f1c0-4c76-bdfd-b1e06a80a9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-216167f5-f1c0-4c76-bdfd-b1e06a80a9a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:36:49.949440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:49.950580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:49.951706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 624/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:49.956769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15ca9d-4c36-45fc-a2fe-3bf9e4adce3c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:50.051656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15ca9d-4c36-45fc-a2fe-3bf9e4adce3c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:50.075155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:50.085246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29471-0428-4011-b5dd-8d9047549e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:50.085841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29471-0428-4011-b5dd-8d9047549e87 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:50.086119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29471-0428-4011-b5dd-8d9047549e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:50.086388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db29471-0428-4011-b5dd-8d9047549e87 None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:50.087130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db29471-0428-4011-b5dd-8d9047549e87 None admin] RBAC: Adding query filter params (name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:50.087411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db29471-0428-4011-b5dd-8d9047549e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:50.088790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db29471-0428-4011-b5dd-8d9047549e87 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:50.096292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 599/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:36:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:50.102518 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216167f5-f1c0-4c76-bdfd-b1e06a80a9a3 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:50.148670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:50.202633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216167f5-f1c0-4c76-bdfd-b1e06a80a9a3 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:50.234346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b2951-1b24-41d2-b0fd-f2e8e62cbe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:50.234988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b2951-1b24-41d2-b0fd-f2e8e62cbe81 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:50.235461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b2951-1b24-41d2-b0fd-f2e8e62cbe81 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:50.235986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b2951-1b24-41d2-b0fd-f2e8e62cbe81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:50.246874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b2951-1b24-41d2-b0fd-f2e8e62cbe81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:50.248353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b2951-1b24-41d2-b0fd-f2e8e62cbe81 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-733b2951-1b24-41d2-b0fd-f2e8e62cbe81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:50.263316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:50.264597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:50.265728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:50.265728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:50.265728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:50.265728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 625/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:50.270380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29471-0428-4011-b5dd-8d9047549e87 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:50.366752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db29471-0428-4011-b5dd-8d9047549e87 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:50.399617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c9ee4-7fbc-4686-9b27-fcc7782d02bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:50.400209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c9ee4-7fbc-4686-9b27-fcc7782d02bf None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:50.400513 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c9ee4-7fbc-4686-9b27-fcc7782d02bf None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:50.400786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148c9ee4-7fbc-4686-9b27-fcc7782d02bf None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:50.401417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c9ee4-7fbc-4686-9b27-fcc7782d02bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:50.401716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c9ee4-7fbc-4686-9b27-fcc7782d02bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:50.403051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148c9ee4-7fbc-4686-9b27-fcc7782d02bf None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:50.415368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 600/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:50.421062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b2951-1b24-41d2-b0fd-f2e8e62cbe81 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:50.512731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:50.519186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b2951-1b24-41d2-b0fd-f2e8e62cbe81 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:50.551537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945caddf-8a76-426f-9688-fcef810aaa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:50.552175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945caddf-8a76-426f-9688-fcef810aaa8c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:50.552462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945caddf-8a76-426f-9688-fcef810aaa8c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:50.552736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945caddf-8a76-426f-9688-fcef810aaa8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:50.560586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945caddf-8a76-426f-9688-fcef810aaa8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:50.566008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945caddf-8a76-426f-9688-fcef810aaa8c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-945caddf-8a76-426f-9688-fcef810aaa8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:36:50.573239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:50.574202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:50.575181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 626/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:50.580207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c9ee4-7fbc-4686-9b27-fcc7782d02bf None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:50.628021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:50.679583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148c9ee4-7fbc-4686-9b27-fcc7782d02bf None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:50.712479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d551b5-6b58-4a0e-851e-956eb34db47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:50.713072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d551b5-6b58-4a0e-851e-956eb34db47e None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:50.713350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d551b5-6b58-4a0e-851e-956eb34db47e None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:50.713616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d551b5-6b58-4a0e-851e-956eb34db47e None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:50.714330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d551b5-6b58-4a0e-851e-956eb34db47e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:50.714628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d551b5-6b58-4a0e-851e-956eb34db47e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:50.716051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d551b5-6b58-4a0e-851e-956eb34db47e None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:50.733177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 601/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 08:36:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:50.739095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945caddf-8a76-426f-9688-fcef810aaa8c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:50.837473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945caddf-8a76-426f-9688-fcef810aaa8c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:50.870229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a1e4-5a3d-4610-92aa-887279606a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:50.870905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a1e4-5a3d-4610-92aa-887279606a2d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:50.871195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a1e4-5a3d-4610-92aa-887279606a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:50.871473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b0a1e4-5a3d-4610-92aa-887279606a2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:50.881975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0a1e4-5a3d-4610-92aa-887279606a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:50.883311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b0a1e4-5a3d-4610-92aa-887279606a2d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-89b0a1e4-5a3d-4610-92aa-887279606a2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:50.897370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:50.898511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:50.900017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:50.900017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:50.900017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:50.900017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 627/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:50.904747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d551b5-6b58-4a0e-851e-956eb34db47e None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:51.002704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d551b5-6b58-4a0e-851e-956eb34db47e None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:51.004963 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:51.035121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363818a0-3c3b-4475-b5e8-5b9a7080f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:51.035741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363818a0-3c3b-4475-b5e8-5b9a7080f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:51.036017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363818a0-3c3b-4475-b5e8-5b9a7080f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:51.036287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363818a0-3c3b-4475-b5e8-5b9a7080f4d8 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:51.036922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363818a0-3c3b-4475-b5e8-5b9a7080f4d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:51.037226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363818a0-3c3b-4475-b5e8-5b9a7080f4d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:51.038690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363818a0-3c3b-4475-b5e8-5b9a7080f4d8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:51.049408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 602/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:51.055209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a1e4-5a3d-4610-92aa-887279606a2d None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:51.065431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:51.154218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b0a1e4-5a3d-4610-92aa-887279606a2d None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:51.187381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73065bf3-9adb-476a-b3ca-f4425c3ecb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:51.188028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73065bf3-9adb-476a-b3ca-f4425c3ecb0e None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:51.188308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73065bf3-9adb-476a-b3ca-f4425c3ecb0e None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:51.188577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73065bf3-9adb-476a-b3ca-f4425c3ecb0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:51.195106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73065bf3-9adb-476a-b3ca-f4425c3ecb0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:51.197138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73065bf3-9adb-476a-b3ca-f4425c3ecb0e None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-73065bf3-9adb-476a-b3ca-f4425c3ecb0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:36:51.208081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:51.208949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:51.209879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:36:51.209879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:36:51.209879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:36:51.209879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:36:51.209879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:36:51.209879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:36:51.209879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:36:51.209879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:51.209879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 628/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:36:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:51.215602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363818a0-3c3b-4475-b5e8-5b9a7080f4d8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:51.313039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363818a0-3c3b-4475-b5e8-5b9a7080f4d8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:51.345924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb249f-1880-4572-983c-81ca8c960767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:51.346517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb249f-1880-4572-983c-81ca8c960767 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:51.346798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb249f-1880-4572-983c-81ca8c960767 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:51.347074 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb249f-1880-4572-983c-81ca8c960767 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:51.347791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb249f-1880-4572-983c-81ca8c960767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:51.348099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb249f-1880-4572-983c-81ca8c960767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:51.349508 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eb249f-1880-4572-983c-81ca8c960767 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:51.361153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 603/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:36:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:51.367189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73065bf3-9adb-476a-b3ca-f4425c3ecb0e None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:51.431265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:51.465108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73065bf3-9adb-476a-b3ca-f4425c3ecb0e None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:51.500640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b5da2-411a-4c1c-9d0a-675b1483a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:51.501302 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b5da2-411a-4c1c-9d0a-675b1483a773 None admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:51.501582 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b5da2-411a-4c1c-9d0a-675b1483a773 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:51.501884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b5da2-411a-4c1c-9d0a-675b1483a773 None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/22aa2b6e4b854de4868b75cc9626b8e5/roles/65669c196efb4b919bf9ee6dd9b1f623` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:51.516658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b5da2-411a-4c1c-9d0a-675b1483a773 None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=22aa2b6e4b854de4868b75cc9626b8e5, role_id=65669c196efb4b919bf9ee6dd9b1f623)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:51.524128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b5da2-411a-4c1c-9d0a-675b1483a773 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:51.603692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 629/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:36:51 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/22aa2b6e4b854de4868b75cc9626b8e5/roles/65669c196efb4b919bf9ee6dd9b1f623 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:36:53.693104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8191a3-a05c-42c7-9218-7dcb83caba57 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:53.693651 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8191a3-a05c-42c7-9218-7dcb83caba57 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:53.693755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8191a3-a05c-42c7-9218-7dcb83caba57 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:53.695070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 604/1233] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:36:53.700222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef55f0-b9cc-4bab-88e1-2b96817d913c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:53.700662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef55f0-b9cc-4bab-88e1-2b96817d913c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:53.700780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef55f0-b9cc-4bab-88e1-2b96817d913c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:53.719274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-42ef55f0-b9cc-4bab-88e1-2b96817d913c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:53.720506 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-42ef55f0-b9cc-4bab-88e1-2b96817d913c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:53.788734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 630/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:36:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:36:54.057954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8191a3-a05c-42c7-9218-7dcb83caba57 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:54.083313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:54.157763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8191a3-a05c-42c7-9218-7dcb83caba57 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:54.190472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc469d-8d68-4a93-af26-afbb14abc19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:54.191140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc469d-8d68-4a93-af26-afbb14abc19b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:54.191586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc469d-8d68-4a93-af26-afbb14abc19b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:54.192479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fc469d-8d68-4a93-af26-afbb14abc19b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.203996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fc469d-8d68-4a93-af26-afbb14abc19b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-80fc469d-8d68-4a93-af26-afbb14abc19b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:36:54.208729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:54.209756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:36:54.210999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 605/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Tue Oct 4 08:36:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:54.216516 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef55f0-b9cc-4bab-88e1-2b96817d913c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:54.261633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:54.313681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef55f0-b9cc-4bab-88e1-2b96817d913c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:54.346013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb080d2-2fdb-45e2-b2eb-28bbc3c555ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:54.346602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb080d2-2fdb-45e2-b2eb-28bbc3c555ef None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:54.346878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb080d2-2fdb-45e2-b2eb-28bbc3c555ef None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:54.347146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb080d2-2fdb-45e2-b2eb-28bbc3c555ef None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.347823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb080d2-2fdb-45e2-b2eb-28bbc3c555ef None admin] RBAC: Adding query filter params (name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:54.348121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb080d2-2fdb-45e2-b2eb-28bbc3c555ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:54.349463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb080d2-2fdb-45e2-b2eb-28bbc3c555ef None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:54.357238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 631/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Tue Oct 4 08:36:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:54.363072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc469d-8d68-4a93-af26-afbb14abc19b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:54.446146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:54.461112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fc469d-8d68-4a93-af26-afbb14abc19b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:54.493600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac94e4-d8ff-4178-89d9-85b588565446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:54.494185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac94e4-d8ff-4178-89d9-85b588565446 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:54.494467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac94e4-d8ff-4178-89d9-85b588565446 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:54.494731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cac94e4-d8ff-4178-89d9-85b588565446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.504145 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac94e4-d8ff-4178-89d9-85b588565446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:54.505566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cac94e4-d8ff-4178-89d9-85b588565446 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-5cac94e4-d8ff-4178-89d9-85b588565446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:54.519742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:54.523320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:54.524988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:54.524988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:54.524988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:36:54.524988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 606/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:54.527205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb080d2-2fdb-45e2-b2eb-28bbc3c555ef None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:54.625070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb080d2-2fdb-45e2-b2eb-28bbc3c555ef None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:54.633539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:54.657736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6682f-e52e-478c-af65-32893b7f87cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:54.658333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6682f-e52e-478c-af65-32893b7f87cf None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:54.658613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6682f-e52e-478c-af65-32893b7f87cf None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:54.658887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6682f-e52e-478c-af65-32893b7f87cf None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.659581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6682f-e52e-478c-af65-32893b7f87cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:54.659883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6682f-e52e-478c-af65-32893b7f87cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:54.663526 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6682f-e52e-478c-af65-32893b7f87cf None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:54.673424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 632/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:54.679046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac94e4-d8ff-4178-89d9-85b588565446 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:54.776969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cac94e4-d8ff-4178-89d9-85b588565446 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:54.810005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab5fad-5108-4e5a-857a-929527a94f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:54.810631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab5fad-5108-4e5a-857a-929527a94f6f None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:54.810909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab5fad-5108-4e5a-857a-929527a94f6f None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:54.811180 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab5fad-5108-4e5a-857a-929527a94f6f None admin] PATH_INFO: `/v3/users/placement` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.813851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:54.818738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab5fad-5108-4e5a-857a-929527a94f6f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:54.820245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab5fad-5108-4e5a-857a-929527a94f6f None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-22ab5fad-5108-4e5a-857a-929527a94f6f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:36:54.831671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:54.832800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:36:54.833737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 607/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:36:54.838602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6682f-e52e-478c-af65-32893b7f87cf None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:54.937437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6682f-e52e-478c-af65-32893b7f87cf None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:54.969659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b9542-697c-4730-9b0c-f13073c9e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:54.970253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b9542-697c-4730-9b0c-f13073c9e393 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:54.970530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b9542-697c-4730-9b0c-f13073c9e393 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:54.970800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3b9542-697c-4730-9b0c-f13073c9e393 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:54.971538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b9542-697c-4730-9b0c-f13073c9e393 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:54.971844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b9542-697c-4730-9b0c-f13073c9e393 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:54.973314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3b9542-697c-4730-9b0c-f13073c9e393 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:54.990250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 633/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 08:36:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:54.996489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab5fad-5108-4e5a-857a-929527a94f6f None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.092633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab5fad-5108-4e5a-857a-929527a94f6f None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:55.125537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25b0c-bddd-4c8e-b4a1-a9cf83af2e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:55.126136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25b0c-bddd-4c8e-b4a1-a9cf83af2e64 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.126416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25b0c-bddd-4c8e-b4a1-a9cf83af2e64 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.126693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd25b0c-bddd-4c8e-b4a1-a9cf83af2e64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.184961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:55.193908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd25b0c-bddd-4c8e-b4a1-a9cf83af2e64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:55.195370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd25b0c-bddd-4c8e-b4a1-a9cf83af2e64 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:55.291051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 608/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:36:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:36:55.296949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b9542-697c-4730-9b0c-f13073c9e393 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.324626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:55.392561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3b9542-697c-4730-9b0c-f13073c9e393 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:55.426837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3964e-4941-4950-9887-d08a0ceeb9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:55.427458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3964e-4941-4950-9887-d08a0ceeb9eb None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.427766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3964e-4941-4950-9887-d08a0ceeb9eb None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.428036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f3964e-4941-4950-9887-d08a0ceeb9eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.438138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3964e-4941-4950-9887-d08a0ceeb9eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:55.439589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f3964e-4941-4950-9887-d08a0ceeb9eb None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-08f3964e-4941-4950-9887-d08a0ceeb9eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:55.453578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:55.454695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:55.456002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:55.456002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:55.456002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:55.456002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 634/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:55.460511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25b0c-bddd-4c8e-b4a1-a9cf83af2e64 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.551076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:55.557195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd25b0c-bddd-4c8e-b4a1-a9cf83af2e64 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:55.592805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde2cff-a066-4c93-babb-2df8470db0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:55.593175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde2cff-a066-4c93-babb-2df8470db0ea None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.593454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde2cff-a066-4c93-babb-2df8470db0ea None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.593731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde2cff-a066-4c93-babb-2df8470db0ea None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.594376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde2cff-a066-4c93-babb-2df8470db0ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:55.594680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde2cff-a066-4c93-babb-2df8470db0ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:55.596073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde2cff-a066-4c93-babb-2df8470db0ea None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:55.607041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 609/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:55.612968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3964e-4941-4950-9887-d08a0ceeb9eb None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.687458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:55.707948 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f3964e-4941-4950-9887-d08a0ceeb9eb None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:55.740427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada0aa3-1964-43d3-a443-c9562c84d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:55.741045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada0aa3-1964-43d3-a443-c9562c84d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.741331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada0aa3-1964-43d3-a443-c9562c84d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.741608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada0aa3-1964-43d3-a443-c9562c84d0a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.748789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada0aa3-1964-43d3-a443-c9562c84d0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:55.750673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada0aa3-1964-43d3-a443-c9562c84d0a1 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-3ada0aa3-1964-43d3-a443-c9562c84d0a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:36:55.761843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:55.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:55.764138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:36:55.764138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:36:55.764138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:36:55.764138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:36:55.764138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:36:55.764138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:36:55.764138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:36:55.764138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:36:55.764138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 635/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:55.768821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde2cff-a066-4c93-babb-2df8470db0ea None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:55.866757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde2cff-a066-4c93-babb-2df8470db0ea None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:55.900538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c859615-cb54-46fd-aefc-464b7be42765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:55.901137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c859615-cb54-46fd-aefc-464b7be42765 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:55.901418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c859615-cb54-46fd-aefc-464b7be42765 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:55.901692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c859615-cb54-46fd-aefc-464b7be42765 None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:55.902383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c859615-cb54-46fd-aefc-464b7be42765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:55.902694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c859615-cb54-46fd-aefc-464b7be42765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:55.904155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c859615-cb54-46fd-aefc-464b7be42765 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:55.916357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 610/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:55.922655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada0aa3-1964-43d3-a443-c9562c84d0a1 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:56.022443 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada0aa3-1964-43d3-a443-c9562c84d0a1 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:56.054844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0e8f49-85ef-4669-8344-95805e5ee30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:56.055434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e8f49-85ef-4669-8344-95805e5ee30a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:56.056270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e8f49-85ef-4669-8344-95805e5ee30a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:56.056546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0e8f49-85ef-4669-8344-95805e5ee30a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:56.057266 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e8f49-85ef-4669-8344-95805e5ee30a None admin] RBAC: Adding query filter params (role.id=65669c196efb4b919bf9ee6dd9b1f623, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=22aa2b6e4b854de4868b75cc9626b8e5) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:56.057573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e8f49-85ef-4669-8344-95805e5ee30a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:56.058984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0e8f49-85ef-4669-8344-95805e5ee30a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:56.064938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 636/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:36:55 2022] GET /identity/v3/role_assignments?user.id=22aa2b6e4b854de4868b75cc9626b8e5&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=65669c196efb4b919bf9ee6dd9b1f623 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:36:58.276681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c768a-fc56-4ccb-b4af-c75bae305dc9 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:58.277241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c768a-fc56-4ccb-b4af-c75bae305dc9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:58.277241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221c768a-fc56-4ccb-b4af-c75bae305dc9 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:58.278566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 611/1247] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:36:58.283856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ff5c-f48d-4825-b57f-8c24c6aff43e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:58.284295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ff5c-f48d-4825-b57f-8c24c6aff43e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:58.284421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455ff5c-f48d-4825-b57f-8c24c6aff43e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:58.291243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:58.304366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-7455ff5c-f48d-4825-b57f-8c24c6aff43e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:36:58.305605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7455ff5c-f48d-4825-b57f-8c24c6aff43e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:36:58.370889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 637/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:36:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:36:58.637909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c768a-fc56-4ccb-b4af-c75bae305dc9 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:58.656295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:58.735593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221c768a-fc56-4ccb-b4af-c75bae305dc9 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:58.768919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240ba54-79a5-4abc-aaf5-1bd93252ea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:58.769523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240ba54-79a5-4abc-aaf5-1bd93252ea72 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:58.769800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240ba54-79a5-4abc-aaf5-1bd93252ea72 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:58.770071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c240ba54-79a5-4abc-aaf5-1bd93252ea72 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:58.780203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c240ba54-79a5-4abc-aaf5-1bd93252ea72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-c240ba54-79a5-4abc-aaf5-1bd93252ea72 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:36:58.784941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:58.786250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:36:58.787157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 612/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:36:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:58.800353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ff5c-f48d-4825-b57f-8c24c6aff43e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:58.885379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455ff5c-f48d-4825-b57f-8c24c6aff43e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:58.918561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:58.924654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938efd09-1b96-4e28-8086-3b5ccbcfd620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:58.925342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938efd09-1b96-4e28-8086-3b5ccbcfd620 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:58.925619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938efd09-1b96-4e28-8086-3b5ccbcfd620 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:58.925887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938efd09-1b96-4e28-8086-3b5ccbcfd620 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:58.926618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938efd09-1b96-4e28-8086-3b5ccbcfd620 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:58.926847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938efd09-1b96-4e28-8086-3b5ccbcfd620 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:58.928251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938efd09-1b96-4e28-8086-3b5ccbcfd620 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:58.937095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 638/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:36:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:58.942945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240ba54-79a5-4abc-aaf5-1bd93252ea72 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:59.018943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:59.041666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c240ba54-79a5-4abc-aaf5-1bd93252ea72 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:59.073412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f069f-3bf1-464b-bd75-f5eeade1ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:59.074033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f069f-3bf1-464b-bd75-f5eeade1ad51 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:59.074313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f069f-3bf1-464b-bd75-f5eeade1ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:59.074587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f069f-3bf1-464b-bd75-f5eeade1ad51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:59.085230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f069f-3bf1-464b-bd75-f5eeade1ad51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:59.086665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f069f-3bf1-464b-bd75-f5eeade1ad51 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-185f069f-3bf1-464b-bd75-f5eeade1ad51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:36:59.101485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:59.102660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:36:59.104125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:36:59.104125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:36:59.104125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:36:59.104125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 613/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:59.109112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938efd09-1b96-4e28-8086-3b5ccbcfd620 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:59.204525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938efd09-1b96-4e28-8086-3b5ccbcfd620 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:59.237218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8094de-626f-41be-b22e-8667c611adee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:59.237810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8094de-626f-41be-b22e-8667c611adee None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:59.238088 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8094de-626f-41be-b22e-8667c611adee None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:59.238357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8094de-626f-41be-b22e-8667c611adee None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:59.238985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8094de-626f-41be-b22e-8667c611adee None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:59.239284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8094de-626f-41be-b22e-8667c611adee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:59.240673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8094de-626f-41be-b22e-8667c611adee None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:59.252339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 639/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:59.257978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f069f-3bf1-464b-bd75-f5eeade1ad51 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:59.355881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f069f-3bf1-464b-bd75-f5eeade1ad51 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:59.381802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:59.389556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790faff1-0161-4048-9fe7-5dd7b86cde30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:59.390173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790faff1-0161-4048-9fe7-5dd7b86cde30 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:59.390448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790faff1-0161-4048-9fe7-5dd7b86cde30 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:59.390714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790faff1-0161-4048-9fe7-5dd7b86cde30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:59.397387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790faff1-0161-4048-9fe7-5dd7b86cde30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:59.398795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790faff1-0161-4048-9fe7-5dd7b86cde30 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-790faff1-0161-4048-9fe7-5dd7b86cde30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:36:59.409898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:36:59.415985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:36:59.417574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 614/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:36:59.418321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8094de-626f-41be-b22e-8667c611adee None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:59.472363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:59.515614 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8094de-626f-41be-b22e-8667c611adee None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:59.549276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428d541-4751-41ba-8ca5-1db344950f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:59.549908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428d541-4751-41ba-8ca5-1db344950f1d None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:59.550194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428d541-4751-41ba-8ca5-1db344950f1d None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:59.550469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d428d541-4751-41ba-8ca5-1db344950f1d None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:59.551192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428d541-4751-41ba-8ca5-1db344950f1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:36:59.551499 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428d541-4751-41ba-8ca5-1db344950f1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:59.552953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d428d541-4751-41ba-8ca5-1db344950f1d None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:59.570250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 640/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 08:36:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:36:59.576790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790faff1-0161-4048-9fe7-5dd7b86cde30 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:59.676812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790faff1-0161-4048-9fe7-5dd7b86cde30 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:59.710219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ac25b-9ae3-4296-a5e3-7400e0a4d8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:36:59.710812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ac25b-9ae3-4296-a5e3-7400e0a4d8c8 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:36:59.711088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ac25b-9ae3-4296-a5e3-7400e0a4d8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:36:59.711355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ac25b-9ae3-4296-a5e3-7400e0a4d8c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:36:59.763853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:36:59.775881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ac25b-9ae3-4296-a5e3-7400e0a4d8c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:36:59.777303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ac25b-9ae3-4296-a5e3-7400e0a4d8c8 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:36:59.870501 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 615/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:36:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:36:59.876547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428d541-4751-41ba-8ca5-1db344950f1d None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:36:59.977146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d428d541-4751-41ba-8ca5-1db344950f1d None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:36:59.990215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:00.012503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4007-b42a-47cf-9129-7e0e80667178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.013120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4007-b42a-47cf-9129-7e0e80667178 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.013422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4007-b42a-47cf-9129-7e0e80667178 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.013691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b4007-b42a-47cf-9129-7e0e80667178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.023585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b4007-b42a-47cf-9129-7e0e80667178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.024959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b4007-b42a-47cf-9129-7e0e80667178 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-ac4b4007-b42a-47cf-9129-7e0e80667178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:00.039590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:00.040701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:00.042087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:00.042087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:00.042087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:00.042087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 641/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:00.046437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ac25b-9ae3-4296-a5e3-7400e0a4d8c8 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.132685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:00.143771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ac25b-9ae3-4296-a5e3-7400e0a4d8c8 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.176041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce964-82c5-4837-ad53-c8d082786111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.176639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce964-82c5-4837-ad53-c8d082786111 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.176915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce964-82c5-4837-ad53-c8d082786111 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.177184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ce964-82c5-4837-ad53-c8d082786111 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.177819 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ce964-82c5-4837-ad53-c8d082786111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:00.178118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ce964-82c5-4837-ad53-c8d082786111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.179574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ce964-82c5-4837-ad53-c8d082786111 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.191100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 616/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:00.197116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4007-b42a-47cf-9129-7e0e80667178 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.295937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b4007-b42a-47cf-9129-7e0e80667178 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.329236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2ff42-387f-48ec-b52e-c4c85d0aefce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.329863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2ff42-387f-48ec-b52e-c4c85d0aefce None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.330146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2ff42-387f-48ec-b52e-c4c85d0aefce None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.330420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2ff42-387f-48ec-b52e-c4c85d0aefce None admin] PATH_INFO: `/v3/projects/service` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.336951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2ff42-387f-48ec-b52e-c4c85d0aefce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.344331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2ff42-387f-48ec-b52e-c4c85d0aefce None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-1ed2ff42-387f-48ec-b52e-c4c85d0aefce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:37:00.349633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:00.350720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:00.351689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:37:00.351689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:37:00.351689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:37:00.351689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:37:00.351689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:37:00.351689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:37:00.351689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:00.351689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:00.351689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 642/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:00.357279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce964-82c5-4837-ad53-c8d082786111 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.454221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ce964-82c5-4837-ad53-c8d082786111 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.486860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb094735-6fe0-4927-81ce-effa0f456efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.487449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb094735-6fe0-4927-81ce-effa0f456efc None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.487755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb094735-6fe0-4927-81ce-effa0f456efc None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.488028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb094735-6fe0-4927-81ce-effa0f456efc None admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.488715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb094735-6fe0-4927-81ce-effa0f456efc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:00.489017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb094735-6fe0-4927-81ce-effa0f456efc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.490422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb094735-6fe0-4927-81ce-effa0f456efc None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.501809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 617/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:00.507752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2ff42-387f-48ec-b52e-c4c85d0aefce None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:00.532785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:00.606043 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2ff42-387f-48ec-b52e-c4c85d0aefce None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:00.638703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c7b64-8833-40a3-b016-fb51bbe91188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:00.639301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7b64-8833-40a3-b016-fb51bbe91188 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:00.639617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7b64-8833-40a3-b016-fb51bbe91188 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:00.639898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c7b64-8833-40a3-b016-fb51bbe91188 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:00.640617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c7b64-8833-40a3-b016-fb51bbe91188 None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=22aa2b6e4b854de4868b75cc9626b8e5) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:00.640969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c7b64-8833-40a3-b016-fb51bbe91188 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:00.642392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c7b64-8833-40a3-b016-fb51bbe91188 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:00.647791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 643/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:37:00 2022] GET /identity/v3/role_assignments?user.id=22aa2b6e4b854de4868b75cc9626b8e5&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:02.756500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b12c5-3ec3-4a97-b524-127f3c5c60c2 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.757049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b12c5-3ec3-4a97-b524-127f3c5c60c2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.757049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b12c5-3ec3-4a97-b524-127f3c5c60c2 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.758440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 618/1261] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:02.763495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58e5d-506a-4531-ac74-db868ead7f14 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:02.763880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58e5d-506a-4531-ac74-db868ead7f14 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:02.764084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd58e5d-506a-4531-ac74-db868ead7f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:02.782232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8fd58e5d-506a-4531-ac74-db868ead7f14 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:02.783411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8fd58e5d-506a-4531-ac74-db868ead7f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:02.849456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 644/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:03.117810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b12c5-3ec3-4a97-b524-127f3c5c60c2 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.129247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:03.220814 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b12c5-3ec3-4a97-b524-127f3c5c60c2 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.254740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ca68-80b0-4267-b412-32b6567868eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.255356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ca68-80b0-4267-b412-32b6567868eb None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.255669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ca68-80b0-4267-b412-32b6567868eb None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.255940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b4ca68-80b0-4267-b412-32b6567868eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.266259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b4ca68-80b0-4267-b412-32b6567868eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-33b4ca68-80b0-4267-b412-32b6567868eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:37:03.271061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:03.272102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:37:03.273121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 619/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 04 08:37:03.278965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58e5d-506a-4531-ac74-db868ead7f14 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.297270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:03.376199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd58e5d-506a-4531-ac74-db868ead7f14 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.409669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc564fb5-31aa-4911-840a-6395f1d0a907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.410282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc564fb5-31aa-4911-840a-6395f1d0a907 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.410564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc564fb5-31aa-4911-840a-6395f1d0a907 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.410836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc564fb5-31aa-4911-840a-6395f1d0a907 None admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.411500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc564fb5-31aa-4911-840a-6395f1d0a907 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:03.411828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc564fb5-31aa-4911-840a-6395f1d0a907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:03.413189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc564fb5-31aa-4911-840a-6395f1d0a907 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:03.421781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 645/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:03.427609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ca68-80b0-4267-b412-32b6567868eb None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.492407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:03.525289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b4ca68-80b0-4267-b412-32b6567868eb None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.558529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121612f7-8dbc-41c8-a779-ec6d7ecaefa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.559148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121612f7-8dbc-41c8-a779-ec6d7ecaefa0 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.559424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121612f7-8dbc-41c8-a779-ec6d7ecaefa0 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.559719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121612f7-8dbc-41c8-a779-ec6d7ecaefa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.570253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121612f7-8dbc-41c8-a779-ec6d7ecaefa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:03.572355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121612f7-8dbc-41c8-a779-ec6d7ecaefa0 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-121612f7-8dbc-41c8-a779-ec6d7ecaefa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:03.586215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:03.587419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:03.588379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:03.588379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:03.588379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:37:03.588379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 620/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:03.593200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc564fb5-31aa-4911-840a-6395f1d0a907 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.672706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:03.691443 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc564fb5-31aa-4911-840a-6395f1d0a907 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.725032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7300be-f0ee-48c0-845a-6e27b8f61fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.725626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7300be-f0ee-48c0-845a-6e27b8f61fb0 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.725900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7300be-f0ee-48c0-845a-6e27b8f61fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.726169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7300be-f0ee-48c0-845a-6e27b8f61fb0 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.726870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7300be-f0ee-48c0-845a-6e27b8f61fb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:03.727161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7300be-f0ee-48c0-845a-6e27b8f61fb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:03.728555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7300be-f0ee-48c0-845a-6e27b8f61fb0 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:03.739164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 646/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:03.745384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121612f7-8dbc-41c8-a779-ec6d7ecaefa0 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:03.842348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121612f7-8dbc-41c8-a779-ec6d7ecaefa0 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:03.862028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:03.876807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaa537-230f-441f-bef1-96835da7045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:03.877447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaa537-230f-441f-bef1-96835da7045a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:03.877717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaa537-230f-441f-bef1-96835da7045a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:03.877997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abaa537-230f-441f-bef1-96835da7045a None admin] PATH_INFO: `/v3/users/placement` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:03.885260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abaa537-230f-441f-bef1-96835da7045a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:03.886678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abaa537-230f-441f-bef1-96835da7045a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-9abaa537-230f-441f-bef1-96835da7045a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:37:03.897664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:03.898644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:37:03.900953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 621/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:03.904662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7300be-f0ee-48c0-845a-6e27b8f61fb0 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:04.004211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7300be-f0ee-48c0-845a-6e27b8f61fb0 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:04.037134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835452f1-52fd-4f74-a477-2054496572c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:04.037737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835452f1-52fd-4f74-a477-2054496572c0 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:04.038022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835452f1-52fd-4f74-a477-2054496572c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:04.038299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835452f1-52fd-4f74-a477-2054496572c0 None admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:04.039021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835452f1-52fd-4f74-a477-2054496572c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:04.039328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835452f1-52fd-4f74-a477-2054496572c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:04.041327 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835452f1-52fd-4f74-a477-2054496572c0 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:04.050141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:04.058643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 647/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 08:37:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:04.064667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaa537-230f-441f-bef1-96835da7045a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:04.160347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abaa537-230f-441f-bef1-96835da7045a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:04.193734 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de70af-be73-4d25-9ba3-4b5f91bb90fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:04.194694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de70af-be73-4d25-9ba3-4b5f91bb90fd None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:04.195131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de70af-be73-4d25-9ba3-4b5f91bb90fd None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:04.195596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1de70af-be73-4d25-9ba3-4b5f91bb90fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:04.206372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de70af-be73-4d25-9ba3-4b5f91bb90fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:04.208083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1de70af-be73-4d25-9ba3-4b5f91bb90fd None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-d1de70af-be73-4d25-9ba3-4b5f91bb90fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:04.231389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:04.239121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:04.240275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:04.240275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:04.240275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:37:04.240275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 622/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:04.240550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835452f1-52fd-4f74-a477-2054496572c0 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:04.334954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835452f1-52fd-4f74-a477-2054496572c0 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:04.368359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ebef0-359a-4b89-a261-5a5eb7c7b84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:04.368973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ebef0-359a-4b89-a261-5a5eb7c7b84c None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:04.369250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ebef0-359a-4b89-a261-5a5eb7c7b84c None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:04.369523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ebef0-359a-4b89-a261-5a5eb7c7b84c None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:04.370180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ebef0-359a-4b89-a261-5a5eb7c7b84c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:04.370464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ebef0-359a-4b89-a261-5a5eb7c7b84c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:04.371847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ebef0-359a-4b89-a261-5a5eb7c7b84c None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:04.382582 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 648/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:04.388437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de70af-be73-4d25-9ba3-4b5f91bb90fd None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:04.421816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:04.486761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1de70af-be73-4d25-9ba3-4b5f91bb90fd None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:04.519500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726dc93-69f7-45cf-9074-e25c29c1ddca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:04.520154 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726dc93-69f7-45cf-9074-e25c29c1ddca None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:04.520434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726dc93-69f7-45cf-9074-e25c29c1ddca None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:04.520709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726dc93-69f7-45cf-9074-e25c29c1ddca None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:04.527792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726dc93-69f7-45cf-9074-e25c29c1ddca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:04.529222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e726dc93-69f7-45cf-9074-e25c29c1ddca None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-e726dc93-69f7-45cf-9074-e25c29c1ddca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:37:04.540203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:04.541815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:04.542804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:37:04.542804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:37:04.542804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:37:04.542804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:37:04.542804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:37:04.542804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:37:04.542804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:04.542804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:37:04.542804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 623/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:04.548040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ebef0-359a-4b89-a261-5a5eb7c7b84c None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:04.606092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:04.645998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ebef0-359a-4b89-a261-5a5eb7c7b84c None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:04.678703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e9d69-6e40-4eba-9595-d29f8a51b8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:04.679462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e9d69-6e40-4eba-9595-d29f8a51b8f8 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:04.679835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e9d69-6e40-4eba-9595-d29f8a51b8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:04.680565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e9d69-6e40-4eba-9595-d29f8a51b8f8 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:04.681292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e9d69-6e40-4eba-9595-d29f8a51b8f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:04.681599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e9d69-6e40-4eba-9595-d29f8a51b8f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:04.683020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137e9d69-6e40-4eba-9595-d29f8a51b8f8 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:04.694941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 649/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:04.701506 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726dc93-69f7-45cf-9074-e25c29c1ddca None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:04.789440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:04.797993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e726dc93-69f7-45cf-9074-e25c29c1ddca None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:04.831537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabccdc9-6b56-4f8b-b412-55147400190b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:04.832199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabccdc9-6b56-4f8b-b412-55147400190b None admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:04.832475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabccdc9-6b56-4f8b-b412-55147400190b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:04.832747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabccdc9-6b56-4f8b-b412-55147400190b None admin] PATH_INFO: `/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/22aa2b6e4b854de4868b75cc9626b8e5/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:04.834592 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabccdc9-6b56-4f8b-b412-55147400190b None admin] RBAC: Authorizing `identity:create_grant(project_id=3ad72f0d57a34795921cf5f09b2b63b4, user_id=22aa2b6e4b854de4868b75cc9626b8e5, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:04.836069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabccdc9-6b56-4f8b-b412-55147400190b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:05.008637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 624/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Tue Oct 4 08:37:04 2022] PUT /identity/v3/projects/3ad72f0d57a34795921cf5f09b2b63b4/users/22aa2b6e4b854de4868b75cc9626b8e5/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:37:07.133208 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0853174-7d2b-419a-8f52-f65939737c19 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.133735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0853174-7d2b-419a-8f52-f65939737c19 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.133735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0853174-7d2b-419a-8f52-f65939737c19 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.135584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 650/1274] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:07.140957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1ebe8-12c4-49b3-9f90-eca18d8d13ca None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.141335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1ebe8-12c4-49b3-9f90-eca18d8d13ca None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.141517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1ebe8-12c4-49b3-9f90-eca18d8d13ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.159986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-50e1ebe8-12c4-49b3-9f90-eca18d8d13ca None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:07.161224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-50e1ebe8-12c4-49b3-9f90-eca18d8d13ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:07.225447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 625/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:07.492272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0853174-7d2b-419a-8f52-f65939737c19 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:07.590319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0853174-7d2b-419a-8f52-f65939737c19 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:07.608453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:07.625126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206362e-3994-43d6-8dd4-c5d5d4e09942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:07.625753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206362e-3994-43d6-8dd4-c5d5d4e09942 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.626035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206362e-3994-43d6-8dd4-c5d5d4e09942 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.626305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206362e-3994-43d6-8dd4-c5d5d4e09942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.636115 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206362e-3994-43d6-8dd4-c5d5d4e09942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-5206362e-3994-43d6-8dd4-c5d5d4e09942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 04 08:37:07.640860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:07.641871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:07.643099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 651/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Tue Oct 4 08:37:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:07.647912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1ebe8-12c4-49b3-9f90-eca18d8d13ca None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:07.726817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:07.746318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1ebe8-12c4-49b3-9f90-eca18d8d13ca None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:07.777234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea653-9a03-4f53-b9fc-16f80d8dad0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:07.777832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea653-9a03-4f53-b9fc-16f80d8dad0b None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.778114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea653-9a03-4f53-b9fc-16f80d8dad0b None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.778385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9ea653-9a03-4f53-b9fc-16f80d8dad0b None admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.779047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ea653-9a03-4f53-b9fc-16f80d8dad0b None admin] RBAC: Adding query filter params (name=admin) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:07.779350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ea653-9a03-4f53-b9fc-16f80d8dad0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:07.780738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9ea653-9a03-4f53-b9fc-16f80d8dad0b None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:07.788351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 626/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Tue Oct 4 08:37:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:07.794873 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206362e-3994-43d6-8dd4-c5d5d4e09942 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:07.897817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206362e-3994-43d6-8dd4-c5d5d4e09942 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:07.931655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c086abf-0115-4987-a74e-de90284e06a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:07.932268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c086abf-0115-4987-a74e-de90284e06a4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:07.932542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c086abf-0115-4987-a74e-de90284e06a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:07.932810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c086abf-0115-4987-a74e-de90284e06a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:07.942708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c086abf-0115-4987-a74e-de90284e06a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:07.944174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c086abf-0115-4987-a74e-de90284e06a4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-7c086abf-0115-4987-a74e-de90284e06a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:07.958903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:07.962291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:07.963409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:07.963409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:07.963409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:07.963409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 652/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:07.965888 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea653-9a03-4f53-b9fc-16f80d8dad0b None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:08.064014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9ea653-9a03-4f53-b9fc-16f80d8dad0b None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.096682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc1cdc-7c2e-4157-9402-f3edba900008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.097274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc1cdc-7c2e-4157-9402-f3edba900008 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.097551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc1cdc-7c2e-4157-9402-f3edba900008 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.097824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc1cdc-7c2e-4157-9402-f3edba900008 None admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.098455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc1cdc-7c2e-4157-9402-f3edba900008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:08.098762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc1cdc-7c2e-4157-9402-f3edba900008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.100177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddc1cdc-7c2e-4157-9402-f3edba900008 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.112206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 627/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:08.117931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c086abf-0115-4987-a74e-de90284e06a4 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:08.147794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.214877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c086abf-0115-4987-a74e-de90284e06a4 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.248029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5937-652d-455c-ad1a-b4c1daf7b8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.248645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5937-652d-455c-ad1a-b4c1daf7b8e1 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.248925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5937-652d-455c-ad1a-b4c1daf7b8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.249272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab5937-652d-455c-ad1a-b4c1daf7b8e1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.255924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5937-652d-455c-ad1a-b4c1daf7b8e1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.257343 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab5937-652d-455c-ad1a-b4c1daf7b8e1 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-46ab5937-652d-455c-ad1a-b4c1daf7b8e1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 04 08:37:08.268626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:08.273032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:08.274401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 653/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:08.276534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc1cdc-7c2e-4157-9402-f3edba900008 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:08.280346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.373924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddc1cdc-7c2e-4157-9402-f3edba900008 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.406346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f051aff-2b94-4b77-acd3-81aa2ea6dd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.406948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f051aff-2b94-4b77-acd3-81aa2ea6dd3a None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.407226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f051aff-2b94-4b77-acd3-81aa2ea6dd3a None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.407496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f051aff-2b94-4b77-acd3-81aa2ea6dd3a None admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.408248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f051aff-2b94-4b77-acd3-81aa2ea6dd3a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:08.408554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f051aff-2b94-4b77-acd3-81aa2ea6dd3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.410005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f051aff-2b94-4b77-acd3-81aa2ea6dd3a None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.426983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 628/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:08.433362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5937-652d-455c-ad1a-b4c1daf7b8e1 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:08.520986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.530060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab5937-652d-455c-ad1a-b4c1daf7b8e1 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.563379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160560-16b9-45aa-af91-3e337d4b769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.564008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160560-16b9-45aa-af91-3e337d4b769a None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.564289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160560-16b9-45aa-af91-3e337d4b769a None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.564563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160560-16b9-45aa-af91-3e337d4b769a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.630781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e160560-16b9-45aa-af91-3e337d4b769a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.632236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e160560-16b9-45aa-af91-3e337d4b769a None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.718420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.728579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 654/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 04 08:37:08.734442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f051aff-2b94-4b77-acd3-81aa2ea6dd3a None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:08.793744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:08.833664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f051aff-2b94-4b77-acd3-81aa2ea6dd3a None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:08.866990 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f48579-31b8-49a5-a77a-e232887e3e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:08.867644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f48579-31b8-49a5-a77a-e232887e3e77 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:08.867925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f48579-31b8-49a5-a77a-e232887e3e77 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:08.868195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f48579-31b8-49a5-a77a-e232887e3e77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:08.880957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f48579-31b8-49a5-a77a-e232887e3e77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:08.882392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f48579-31b8-49a5-a77a-e232887e3e77 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-89f48579-31b8-49a5-a77a-e232887e3e77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 04 08:37:08.896800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:08.899444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 04 08:37:08.900660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 04 08:37:08.900660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 04 08:37:08.900660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:37:08.900660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 629/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:08.903720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160560-16b9-45aa-af91-3e337d4b769a None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.001883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160560-16b9-45aa-af91-3e337d4b769a None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:09.035670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2029b66-199b-4e2f-82c9-874ec77f9cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:09.036273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2029b66-199b-4e2f-82c9-874ec77f9cf1 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.036606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2029b66-199b-4e2f-82c9-874ec77f9cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.036866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2029b66-199b-4e2f-82c9-874ec77f9cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.037502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2029b66-199b-4e2f-82c9-874ec77f9cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:09.037808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2029b66-199b-4e2f-82c9-874ec77f9cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:09.039226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2029b66-199b-4e2f-82c9-874ec77f9cf1 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:09.050527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 655/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Tue Oct 4 08:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:09.056893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f48579-31b8-49a5-a77a-e232887e3e77 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.154701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f48579-31b8-49a5-a77a-e232887e3e77 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:09.168153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:09.188084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc02b54-abc3-400e-9b54-ef9538d71991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:09.188727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02b54-abc3-400e-9b54-ef9538d71991 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.189006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02b54-abc3-400e-9b54-ef9538d71991 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.189276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc02b54-abc3-400e-9b54-ef9538d71991 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.195661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc02b54-abc3-400e-9b54-ef9538d71991 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:09.197082 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc02b54-abc3-400e-9b54-ef9538d71991 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application [None req-1bc02b54-abc3-400e-9b54-ef9538d71991 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 04 08:37:09.207824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:09.209120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:09.210371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 04 08:37:09.210371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 04 08:37:09.210371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 04 08:37:09.210371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 04 08:37:09.210371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 04 08:37:09.210371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 04 08:37:09.210371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 04 08:37:09.210371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: ERROR keystone.server.flask.application Oct 04 08:37:09.210371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 630/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Tue Oct 4 08:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:09.214961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2029b66-199b-4e2f-82c9-874ec77f9cf1 None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.265101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:09.314118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2029b66-199b-4e2f-82c9-874ec77f9cf1 None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:09.350979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf53c838-b866-482a-9b21-dc2dbefa82a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:09.351636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53c838-b866-482a-9b21-dc2dbefa82a4 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.351929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53c838-b866-482a-9b21-dc2dbefa82a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.352205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf53c838-b866-482a-9b21-dc2dbefa82a4 None admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.353428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53c838-b866-482a-9b21-dc2dbefa82a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:09.353745 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53c838-b866-482a-9b21-dc2dbefa82a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:09.355280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf53c838-b866-482a-9b21-dc2dbefa82a4 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:09.374914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 656/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Tue Oct 4 08:37:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:09.376207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc02b54-abc3-400e-9b54-ef9538d71991 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:09.492224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc02b54-abc3-400e-9b54-ef9538d71991 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:09.529493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc59fb7-fb18-437b-9838-b94344e877be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:09.530112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc59fb7-fb18-437b-9838-b94344e877be None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:09.530393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc59fb7-fb18-437b-9838-b94344e877be None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:09.530665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc59fb7-fb18-437b-9838-b94344e877be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:09.531420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc59fb7-fb18-437b-9838-b94344e877be None admin] RBAC: Adding query filter params (role.id=22ae1ab040b44fca82f063e1ab912517, scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4, user.id=22aa2b6e4b854de4868b75cc9626b8e5) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:09.531759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc59fb7-fb18-437b-9838-b94344e877be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:09.533223 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc59fb7-fb18-437b-9838-b94344e877be None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:09.539929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 631/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Tue Oct 4 08:37:09 2022] GET /identity/v3/role_assignments?user.id=22aa2b6e4b854de4868b75cc9626b8e5&scope.project.id=3ad72f0d57a34795921cf5f09b2b63b4&role.id=22ae1ab040b44fca82f063e1ab912517 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:11.734271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da050-3308-4184-bf9e-7c4702fb17c4 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.734985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da050-3308-4184-bf9e-7c4702fb17c4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.734985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988da050-3308-4184-bf9e-7c4702fb17c4 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.736218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 657/1288] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:11.741375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec9fad-1081-446e-8203-f70c8e354e1d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:11.744195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec9fad-1081-446e-8203-f70c8e354e1d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:11.744195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eec9fad-1081-446e-8203-f70c8e354e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:11.760956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-2eec9fad-1081-446e-8203-f70c8e354e1d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:11.762137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2eec9fad-1081-446e-8203-f70c8e354e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:11.790121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:11.826160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 632/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:12.099947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988da050-3308-4184-bf9e-7c4702fb17c4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:12.199555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988da050-3308-4184-bf9e-7c4702fb17c4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:12.209932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:12.232673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e996cd-cde3-4161-93a8-e92c37523d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:12.234042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e996cd-cde3-4161-93a8-e92c37523d0b None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:12.234042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e996cd-cde3-4161-93a8-e92c37523d0b None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:12.234042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e996cd-cde3-4161-93a8-e92c37523d0b None admin] PATH_INFO: `/v3/services/placement` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:12.234379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e996cd-cde3-4161-93a8-e92c37523d0b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:12.235764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e996cd-cde3-4161-93a8-e92c37523d0b None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-63e996cd-cde3-4161-93a8-e92c37523d0b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:12.244842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:12.245897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:12.246802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 658/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:37:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:12.251898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec9fad-1081-446e-8203-f70c8e354e1d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:12.347308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eec9fad-1081-446e-8203-f70c8e354e1d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:12.383119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7a9a2f-9db5-4015-8b69-6ae8f2723dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:12.383119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9a2f-9db5-4015-8b69-6ae8f2723dbb None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:12.383119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9a2f-9db5-4015-8b69-6ae8f2723dbb None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:12.383119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7a9a2f-9db5-4015-8b69-6ae8f2723dbb None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:12.383570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9a2f-9db5-4015-8b69-6ae8f2723dbb None admin] RBAC: Adding query filter params (name=placement) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:12.383570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9a2f-9db5-4015-8b69-6ae8f2723dbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:12.384076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7a9a2f-9db5-4015-8b69-6ae8f2723dbb None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:12.388794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 633/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 4 08:37:12 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:12.394586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e996cd-cde3-4161-93a8-e92c37523d0b None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:12.491515 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e996cd-cde3-4161-93a8-e92c37523d0b None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:12.523494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7658ac-1a3f-45f7-878e-152fcc5058bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:12.524118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7658ac-1a3f-45f7-878e-152fcc5058bd None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:12.524395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7658ac-1a3f-45f7-878e-152fcc5058bd None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:12.524670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7658ac-1a3f-45f7-878e-152fcc5058bd None admin] PATH_INFO: `/v3/services` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:12.525816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7658ac-1a3f-45f7-878e-152fcc5058bd None admin] RBAC: Adding query filter params (type=placement) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:12.526118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7658ac-1a3f-45f7-878e-152fcc5058bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:12.527474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7658ac-1a3f-45f7-878e-152fcc5058bd None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:12.532167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 659/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 4 08:37:12 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:14.655946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dea24-0dc9-4b9e-8772-1884b58df890 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:14.656474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dea24-0dc9-4b9e-8772-1884b58df890 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:14.656572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5dea24-0dc9-4b9e-8772-1884b58df890 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:14.657857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 634/1293] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:14.663153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66853e52-7846-471c-8cc9-f6be291f2d6f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:14.663584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66853e52-7846-471c-8cc9-f6be291f2d6f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:14.663725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66853e52-7846-471c-8cc9-f6be291f2d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:14.682395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-66853e52-7846-471c-8cc9-f6be291f2d6f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:14.683597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-66853e52-7846-471c-8cc9-f6be291f2d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:14.712027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:14.748108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 660/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:15.015051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dea24-0dc9-4b9e-8772-1884b58df890 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:15.045797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:15.112638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5dea24-0dc9-4b9e-8772-1884b58df890 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:15.148694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdc315d-655e-465b-b92e-89786eddbefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:15.149303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc315d-655e-465b-b92e-89786eddbefc None admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:15.149585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc315d-655e-465b-b92e-89786eddbefc None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:15.149855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdc315d-655e-465b-b92e-89786eddbefc None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:15.150516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc315d-655e-465b-b92e-89786eddbefc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:15.151906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdc315d-655e-465b-b92e-89786eddbefc None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:15.225856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 635/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Tue Oct 4 08:37:15 2022] POST /identity/v3/services => generated 246 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:17.374368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659126c1-0235-4bda-bed8-4e4cf6faf75c None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.374925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659126c1-0235-4bda-bed8-4e4cf6faf75c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.374925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659126c1-0235-4bda-bed8-4e4cf6faf75c None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.376290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 661/1296] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:17.381550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906453d-a3d3-4d3a-9920-3410b7c1e37e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.381995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906453d-a3d3-4d3a-9920-3410b7c1e37e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.382095 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906453d-a3d3-4d3a-9920-3410b7c1e37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.400925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-2906453d-a3d3-4d3a-9920-3410b7c1e37e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:17.409035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2906453d-a3d3-4d3a-9920-3410b7c1e37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:17.472474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 636/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:17 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:17.744104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659126c1-0235-4bda-bed8-4e4cf6faf75c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:17.842902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659126c1-0235-4bda-bed8-4e4cf6faf75c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:17.876442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2905f18-2051-4bba-9eac-d6d200d63daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:17.877060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2905f18-2051-4bba-9eac-d6d200d63daa None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:17.877340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2905f18-2051-4bba-9eac-d6d200d63daa None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:17.877617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2905f18-2051-4bba-9eac-d6d200d63daa None admin] PATH_INFO: `/v3/services/placement` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:17.878246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2905f18-2051-4bba-9eac-d6d200d63daa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:17.879630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2905f18-2051-4bba-9eac-d6d200d63daa None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-b2905f18-2051-4bba-9eac-d6d200d63daa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:17.888193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:17.889397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:17.890514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 662/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:37:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:17.895559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906453d-a3d3-4d3a-9920-3410b7c1e37e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:17.913632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:17.993468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906453d-a3d3-4d3a-9920-3410b7c1e37e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:18.026018 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63831d2-d6aa-42cf-abc9-9356b1403b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:18.026634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63831d2-d6aa-42cf-abc9-9356b1403b62 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:18.026915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63831d2-d6aa-42cf-abc9-9356b1403b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:18.027190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63831d2-d6aa-42cf-abc9-9356b1403b62 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:18.027850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63831d2-d6aa-42cf-abc9-9356b1403b62 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:18.028157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63831d2-d6aa-42cf-abc9-9356b1403b62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:18.029517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63831d2-d6aa-42cf-abc9-9356b1403b62 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:18.034503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 637/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 4 08:37:17 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:18.040583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2905f18-2051-4bba-9eac-d6d200d63daa None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:18.073015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:18.137207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2905f18-2051-4bba-9eac-d6d200d63daa None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:18.170201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4c81b-4dd2-4ef2-a4fc-8e48b40a2e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:18.170795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4c81b-4dd2-4ef2-a4fc-8e48b40a2e01 None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:18.171077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4c81b-4dd2-4ef2-a4fc-8e48b40a2e01 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:18.171359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4c81b-4dd2-4ef2-a4fc-8e48b40a2e01 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:18.172080 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4c81b-4dd2-4ef2-a4fc-8e48b40a2e01 None admin] RBAC: Adding query filter params (interface=public, service_id=9f4b17a20bae4c6fa568d688e19309f7, region_id=RegionOne) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:18.172393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4c81b-4dd2-4ef2-a4fc-8e48b40a2e01 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:18.173748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4c81b-4dd2-4ef2-a4fc-8e48b40a2e01 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:18.178630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 663/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Tue Oct 4 08:37:18 2022] GET /identity/v3/endpoints?service_id=9f4b17a20bae4c6fa568d688e19309f7&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:18.184346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63831d2-d6aa-42cf-abc9-9356b1403b62 None admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:18.263451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:18.281010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63831d2-d6aa-42cf-abc9-9356b1403b62 None admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:18.313600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ba902-453d-4a77-ad24-7ca0fd2212c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:18.314200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ba902-453d-4a77-ad24-7ca0fd2212c7 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:18.314479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ba902-453d-4a77-ad24-7ca0fd2212c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:18.314783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ba902-453d-4a77-ad24-7ca0fd2212c7 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:18.315379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ba902-453d-4a77-ad24-7ca0fd2212c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:18.316758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3ba902-453d-4a77-ad24-7ca0fd2212c7 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:18.323850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 638/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Tue Oct 4 08:37:18 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:37:20.467392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faaa23-1713-4674-99b2-587063e90558 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:20.467980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faaa23-1713-4674-99b2-587063e90558 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:20.467980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75faaa23-1713-4674-99b2-587063e90558 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:20.469344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 664/1302] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:37:20.474653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b45398-d5e7-43d0-a7c8-eb964b4dbd65 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:20.475073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b45398-d5e7-43d0-a7c8-eb964b4dbd65 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:20.475207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b45398-d5e7-43d0-a7c8-eb964b4dbd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:20.493456 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b4b45398-d5e7-43d0-a7c8-eb964b4dbd65 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:37:20.495286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b4b45398-d5e7-43d0-a7c8-eb964b4dbd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:37:20.560234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 639/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:37:20 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 04 08:37:20.822731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faaa23-1713-4674-99b2-587063e90558 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:20.913142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:20.920212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75faaa23-1713-4674-99b2-587063e90558 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:20.951949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7226-d644-408b-a1ed-81d45167f49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:20.952560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7226-d644-408b-a1ed-81d45167f49f None admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:20.952838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7226-d644-408b-a1ed-81d45167f49f None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:20.953109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe7226-d644-408b-a1ed-81d45167f49f None admin] PATH_INFO: `/v3/services/placement` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:20.953682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7226-d644-408b-a1ed-81d45167f49f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:20.955028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebe7226-d644-408b-a1ed-81d45167f49f None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application [None req-9ebe7226-d644-408b-a1ed-81d45167f49f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 04 08:37:20.963947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 04 08:37:20.965151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.get_or_create( Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application with Lock( Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self._enter() Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application return self.creator() Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application created_value = creator( Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: ERROR keystone.server.flask.application Oct 04 08:37:20.966179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 665/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Tue Oct 4 08:37:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 04 08:37:20.971014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b45398-d5e7-43d0-a7c8-eb964b4dbd65 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:21.045055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:21.067236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b45398-d5e7-43d0-a7c8-eb964b4dbd65 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:21.100115 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73467ff-7f42-4c8a-962a-e6e2b8ef61c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:21.100645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73467ff-7f42-4c8a-962a-e6e2b8ef61c3 None admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:21.100921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73467ff-7f42-4c8a-962a-e6e2b8ef61c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:21.101190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73467ff-7f42-4c8a-962a-e6e2b8ef61c3 None admin] PATH_INFO: `/v3/services` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:21.101809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73467ff-7f42-4c8a-962a-e6e2b8ef61c3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:37:21.102109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73467ff-7f42-4c8a-962a-e6e2b8ef61c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:21.103981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73467ff-7f42-4c8a-962a-e6e2b8ef61c3 None admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:21.108853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 640/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Tue Oct 4 08:37:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:37:21.114810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7226-d644-408b-a1ed-81d45167f49f None admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:37:21.211722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe7226-d644-408b-a1ed-81d45167f49f None admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:37:21.243886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac960e52-7f5d-4e12-af35-d250e05e5837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:37:21.245054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960e52-7f5d-4e12-af35-d250e05e5837 None admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:37:21.245329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960e52-7f5d-4e12-af35-d250e05e5837 None admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:37:21.245600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac960e52-7f5d-4e12-af35-d250e05e5837 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:37:21.246249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac960e52-7f5d-4e12-af35-d250e05e5837 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:37:21.247624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac960e52-7f5d-4e12-af35-d250e05e5837 None admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:37:21.357970 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 666/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:37:21 2022] POST /identity/v3/endpoints => generated 331 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:37:31.142858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=30 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:37:31.352983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:14.793698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d8bb-da09-43a3-8b03-c2ea09265e67 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:14.794185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d8bb-da09-43a3-8b03-c2ea09265e67 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:14.794278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd58d8bb-da09-43a3-8b03-c2ea09265e67 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.801336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a99192-4d55-48fb-be02-141b1f04d444 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:14.801856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a99192-4d55-48fb-be02-141b1f04d444 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:14.801946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a99192-4d55-48fb-be02-141b1f04d444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:14.806532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 641/1307] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:14.882565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f8a99192-4d55-48fb-be02-141b1f04d444 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:14.883942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f8a99192-4d55-48fb-be02-141b1f04d444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:14.991997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 667/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:43:15.289493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066e8d5-cf55-44a4-9a62-cbbd4fae8aa1 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.290094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066e8d5-cf55-44a4-9a62-cbbd4fae8aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.290479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066e8d5-cf55-44a4-9a62-cbbd4fae8aa1 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.292205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 642/1309] 10.222.0.25 () {54 vars in 964 bytes} [Tue Oct 4 08:43:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:15.298766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818aa9-e84f-44fc-9f4b-3cf12b303ab7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.299078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818aa9-e84f-44fc-9f4b-3cf12b303ab7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.299375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53818aa9-e84f-44fc-9f4b-3cf12b303ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.382075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-53818aa9-e84f-44fc-9f4b-3cf12b303ab7 None None] MFA Rules not processed for user `a269743c34bc48edaab5c0e3e78074c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:15.383407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-53818aa9-e84f-44fc-9f4b-3cf12b303ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:15.404962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:15.462994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 668/1310] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Oct 4 08:43:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:15.472045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066e8d5-cf55-44a4-9a62-cbbd4fae8aa1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:15.473946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b066e8d5-cf55-44a4-9a62-cbbd4fae8aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:15.599358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066e8d5-cf55-44a4-9a62-cbbd4fae8aa1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:15.679721 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b942783-9b33-4b37-8d76-b063d1374b2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:15.680330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942783-9b33-4b37-8d76-b063d1374b2a service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:15.680605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942783-9b33-4b37-8d76-b063d1374b2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:15.680881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b942783-9b33-4b37-8d76-b063d1374b2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:15.682436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7b942783-9b33-4b37-8d76-b063d1374b2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:15.742009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:15.798032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b942783-9b33-4b37-8d76-b063d1374b2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:15.799455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b942783-9b33-4b37-8d76-b063d1374b2a service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:15.818702 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 643/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:18.284287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096545bf-6be9-41ef-a416-3b65fbb5d3f5 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:18.284791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096545bf-6be9-41ef-a416-3b65fbb5d3f5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:18.284791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096545bf-6be9-41ef-a416-3b65fbb5d3f5 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:18.286603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 669/1312] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:18.292017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b38f99-52d8-4676-a3bf-027f64ec7e10 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:18.292424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b38f99-52d8-4676-a3bf-027f64ec7e10 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:18.292698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b38f99-52d8-4676-a3bf-027f64ec7e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:18.374787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-c7b38f99-52d8-4676-a3bf-027f64ec7e10 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:18.376048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c7b38f99-52d8-4676-a3bf-027f64ec7e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:18.469988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 644/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:18.748872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096545bf-6be9-41ef-a416-3b65fbb5d3f5 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:18.750406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-096545bf-6be9-41ef-a416-3b65fbb5d3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:18.853279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096545bf-6be9-41ef-a416-3b65fbb5d3f5 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:18.924164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:18.926230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305dcb4-f255-4daf-adfc-c9b717c95337 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:18.926909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305dcb4-f255-4daf-adfc-c9b717c95337 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:18.927198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305dcb4-f255-4daf-adfc-c9b717c95337 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:18.927475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305dcb4-f255-4daf-adfc-c9b717c95337 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:18.929138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b305dcb4-f255-4daf-adfc-c9b717c95337 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:19.037504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305dcb4-f255-4daf-adfc-c9b717c95337 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:19.038940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305dcb4-f255-4daf-adfc-c9b717c95337 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:19.056247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 670/1314] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:21.646276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff126-89df-4de7-9670-9094de605030 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.646794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff126-89df-4de7-9670-9094de605030 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.646893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dff126-89df-4de7-9670-9094de605030 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.648195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 645/1315] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:21.653480 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb092-df44-41b7-9b27-0b848df5cf5e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:21.654010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb092-df44-41b7-9b27-0b848df5cf5e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:21.654010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933bb092-df44-41b7-9b27-0b848df5cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:21.719603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-933bb092-df44-41b7-9b27-0b848df5cf5e None None] MFA Rules not processed for user `60efaef5a97045e9b275fbdb11feb3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:21.720806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-933bb092-df44-41b7-9b27-0b848df5cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:21.771113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:21.813685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 671/1316] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:21 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:22.095722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dff126-89df-4de7-9670-9094de605030 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:22.097833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-73dff126-89df-4de7-9670-9094de605030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:22.108317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:22.200291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dff126-89df-4de7-9670-9094de605030 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:22.273519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2ff473-d8bd-48ec-973f-f2d5019ffe11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:22.274045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ff473-d8bd-48ec-973f-f2d5019ffe11 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:22.274316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ff473-d8bd-48ec-973f-f2d5019ffe11 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:22.274581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2ff473-d8bd-48ec-973f-f2d5019ffe11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:22.276172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ff2ff473-d8bd-48ec-973f-f2d5019ffe11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:22.335232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:22.379169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ff473-d8bd-48ec-973f-f2d5019ffe11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:22.380605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2ff473-d8bd-48ec-973f-f2d5019ffe11 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:22.398504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 646/1317] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:25.236316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93187-1869-464d-9bde-43de4ec83751 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.236858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93187-1869-464d-9bde-43de4ec83751 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.236858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f93187-1869-464d-9bde-43de4ec83751 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.238689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 672/1318] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:25.243974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e826d6-a540-453d-9eaa-abc48bbdda18 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.244442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e826d6-a540-453d-9eaa-abc48bbdda18 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.244552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e826d6-a540-453d-9eaa-abc48bbdda18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.308405 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-e3e826d6-a540-453d-9eaa-abc48bbdda18 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:25.309605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e3e826d6-a540-453d-9eaa-abc48bbdda18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:25.403058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 647/1319] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:25.686338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93187-1869-464d-9bde-43de4ec83751 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:25.687893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b7f93187-1869-464d-9bde-43de4ec83751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:25.793338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f93187-1869-464d-9bde-43de4ec83751 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:25.863919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41360a49-0a43-44d2-ac0d-109c2845cb71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:25.864451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360a49-0a43-44d2-ac0d-109c2845cb71 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:25.864732 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360a49-0a43-44d2-ac0d-109c2845cb71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:25.864996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41360a49-0a43-44d2-ac0d-109c2845cb71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:25.866558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-41360a49-0a43-44d2-ac0d-109c2845cb71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:25.873162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:25.970629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360a49-0a43-44d2-ac0d-109c2845cb71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:25.972678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41360a49-0a43-44d2-ac0d-109c2845cb71 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:25.989724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 673/1320] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:29.107866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f64fb-6974-4cd4-a9bf-91ca72d0c77e None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:29.108402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f64fb-6974-4cd4-a9bf-91ca72d0c77e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:29.108515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75f64fb-6974-4cd4-a9bf-91ca72d0c77e None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:29.109816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 648/1321] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:29.115241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee962ab-54a4-4264-a0fc-b59e0c0690ca None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:29.116106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee962ab-54a4-4264-a0fc-b59e0c0690ca None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:29.116384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee962ab-54a4-4264-a0fc-b59e0c0690ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:29.181412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-cee962ab-54a4-4264-a0fc-b59e0c0690ca None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:29.182615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cee962ab-54a4-4264-a0fc-b59e0c0690ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:29.240498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:29.278827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 674/1322] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:29.563103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f64fb-6974-4cd4-a9bf-91ca72d0c77e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:29.564681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b75f64fb-6974-4cd4-a9bf-91ca72d0c77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:29.585639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:29.669696 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75f64fb-6974-4cd4-a9bf-91ca72d0c77e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:29.745272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca61cb-3fca-4919-a35c-76d2860b2b8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:29.745880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca61cb-3fca-4919-a35c-76d2860b2b8d service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:29.746158 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca61cb-3fca-4919-a35c-76d2860b2b8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:29.746432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca61cb-3fca-4919-a35c-76d2860b2b8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:29.748052 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d4ca61cb-3fca-4919-a35c-76d2860b2b8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:29.817958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:29.855628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca61cb-3fca-4919-a35c-76d2860b2b8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:29.857085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca61cb-3fca-4919-a35c-76d2860b2b8d service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:29.875300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 649/1323] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:32.084782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70dc4f-edd1-4568-bb24-c2c8086690a7 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.085277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70dc4f-edd1-4568-bb24-c2c8086690a7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.085386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c70dc4f-edd1-4568-bb24-c2c8086690a7 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.086662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 675/1324] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:32.092051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6355a-f30e-4fd8-aef3-8d3b3d55b0cf None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.092440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6355a-f30e-4fd8-aef3-8d3b3d55b0cf None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.092734 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6355a-f30e-4fd8-aef3-8d3b3d55b0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.163778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9fb6355a-f30e-4fd8-aef3-8d3b3d55b0cf None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:32.165012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9fb6355a-f30e-4fd8-aef3-8d3b3d55b0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:32.260657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 650/1325] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:32.540278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70dc4f-edd1-4568-bb24-c2c8086690a7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:32.541878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3c70dc4f-edd1-4568-bb24-c2c8086690a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:32.645769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c70dc4f-edd1-4568-bb24-c2c8086690a7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:32.719584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7be33b-f8a6-4a9b-bda0-de26702b452e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:32.720187 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7be33b-f8a6-4a9b-bda0-de26702b452e service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:32.720466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7be33b-f8a6-4a9b-bda0-de26702b452e service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:32.720744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7be33b-f8a6-4a9b-bda0-de26702b452e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:32.722925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cc7be33b-f8a6-4a9b-bda0-de26702b452e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:32.739542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:32.835733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7be33b-f8a6-4a9b-bda0-de26702b452e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:32.837101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7be33b-f8a6-4a9b-bda0-de26702b452e service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:32.855693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 676/1326] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:35.073171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b23cc-317b-463b-93fc-12839398e91f None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.073712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b23cc-317b-463b-93fc-12839398e91f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.073712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b23cc-317b-463b-93fc-12839398e91f None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.075071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 651/1327] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:35.080439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a52dbf-4011-4a34-96d6-d9c54eaa0d85 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.080869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a52dbf-4011-4a34-96d6-d9c54eaa0d85 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.080986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a52dbf-4011-4a34-96d6-d9c54eaa0d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.145449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-87a52dbf-4011-4a34-96d6-d9c54eaa0d85 None None] MFA Rules not processed for user `60efaef5a97045e9b275fbdb11feb3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:35.146646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-87a52dbf-4011-4a34-96d6-d9c54eaa0d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:35.210286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.240737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 677/1328] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:35.527023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b23cc-317b-463b-93fc-12839398e91f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:35.528587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-921b23cc-317b-463b-93fc-12839398e91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:35.561862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.638784 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b23cc-317b-463b-93fc-12839398e91f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:35.716882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df11b7ee-4d67-4689-a75a-300d3c128c52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:35.717500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11b7ee-4d67-4689-a75a-300d3c128c52 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:35.717807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11b7ee-4d67-4689-a75a-300d3c128c52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:35.718081 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df11b7ee-4d67-4689-a75a-300d3c128c52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:35.719717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-df11b7ee-4d67-4689-a75a-300d3c128c52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:35.798160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:35.830646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11b7ee-4d67-4689-a75a-300d3c128c52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:35.832125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df11b7ee-4d67-4689-a75a-300d3c128c52 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:35.850384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 652/1329] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:38.469151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e96bd0-f692-4f5f-963f-f135b391453e None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.469698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e96bd0-f692-4f5f-963f-f135b391453e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.469698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e96bd0-f692-4f5f-963f-f135b391453e None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.471076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 678/1330] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:38.476325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90db17-0fb7-4452-9b75-ea403bb36782 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:38.476773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90db17-0fb7-4452-9b75-ea403bb36782 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:38.476869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90db17-0fb7-4452-9b75-ea403bb36782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:38.540897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ae90db17-0fb7-4452-9b75-ea403bb36782 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:38.542109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ae90db17-0fb7-4452-9b75-ea403bb36782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:38.636007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 653/1331] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:38.914093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e96bd0-f692-4f5f-963f-f135b391453e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:38.915679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-02e96bd0-f692-4f5f-963f-f135b391453e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:39.016193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e96bd0-f692-4f5f-963f-f135b391453e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:39.087732 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea48a47a-196f-40dc-bcaf-c3b08893d8ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:39.088334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48a47a-196f-40dc-bcaf-c3b08893d8ec service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:39.088619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48a47a-196f-40dc-bcaf-c3b08893d8ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:39.088891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea48a47a-196f-40dc-bcaf-c3b08893d8ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:39.090478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ea48a47a-196f-40dc-bcaf-c3b08893d8ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:39.117906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:39.201732 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48a47a-196f-40dc-bcaf-c3b08893d8ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:39.203177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea48a47a-196f-40dc-bcaf-c3b08893d8ec service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:39.222495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 679/1332] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:41.400883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2295bc-317c-4d97-900d-08f96aca518c None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.401428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2295bc-317c-4d97-900d-08f96aca518c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.401428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2295bc-317c-4d97-900d-08f96aca518c None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.402769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 654/1333] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:41.408072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dea95e-01b1-4bd8-8290-30c20bb2d45f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:41.409007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dea95e-01b1-4bd8-8290-30c20bb2d45f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:41.409150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dea95e-01b1-4bd8-8290-30c20bb2d45f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:41.475671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-21dea95e-01b1-4bd8-8290-30c20bb2d45f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:41.476883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-21dea95e-01b1-4bd8-8290-30c20bb2d45f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:41.548630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.570608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 680/1334] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:41.856775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2295bc-317c-4d97-900d-08f96aca518c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:41.858305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ec2295bc-317c-4d97-900d-08f96aca518c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:41.897522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:41.959710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2295bc-317c-4d97-900d-08f96aca518c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:42.031436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988f910-063c-4ffe-9a52-aebc64ad3d8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:42.032078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988f910-063c-4ffe-9a52-aebc64ad3d8d service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:42.032356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988f910-063c-4ffe-9a52-aebc64ad3d8d service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:42.032630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988f910-063c-4ffe-9a52-aebc64ad3d8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:42.034864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2988f910-063c-4ffe-9a52-aebc64ad3d8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:42.116445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:42.141188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988f910-063c-4ffe-9a52-aebc64ad3d8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:42.142602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988f910-063c-4ffe-9a52-aebc64ad3d8d service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:42.160698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 655/1335] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:44.878512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50959fa-4fdd-42fb-a02d-91abab8efedf None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.879040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50959fa-4fdd-42fb-a02d-91abab8efedf None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.879040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50959fa-4fdd-42fb-a02d-91abab8efedf None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.880441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 681/1336] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:44.885815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa525d-b43d-444d-9d74-5b4c650ad3e8 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:44.886219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa525d-b43d-444d-9d74-5b4c650ad3e8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:44.886359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aa525d-b43d-444d-9d74-5b4c650ad3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:44.950909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-18aa525d-b43d-444d-9d74-5b4c650ad3e8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:44.952122 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-18aa525d-b43d-444d-9d74-5b4c650ad3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:45.048270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 656/1337] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:45.328512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50959fa-4fdd-42fb-a02d-91abab8efedf None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:45.330672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d50959fa-4fdd-42fb-a02d-91abab8efedf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:45.429905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50959fa-4fdd-42fb-a02d-91abab8efedf None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:45.503609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae01b21-e613-4e23-892e-dbdaaba7bad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:45.504207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae01b21-e613-4e23-892e-dbdaaba7bad4 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:45.504482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae01b21-e613-4e23-892e-dbdaaba7bad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:45.504751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae01b21-e613-4e23-892e-dbdaaba7bad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:45.506309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2ae01b21-e613-4e23-892e-dbdaaba7bad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:45.540006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:45.610702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae01b21-e613-4e23-892e-dbdaaba7bad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:45.613521 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae01b21-e613-4e23-892e-dbdaaba7bad4 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:45.632244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 682/1338] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:49.914415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf94bf-7e10-4cac-a4ea-e4f079a7dd64 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:49.914969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf94bf-7e10-4cac-a4ea-e4f079a7dd64 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:49.914969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf94bf-7e10-4cac-a4ea-e4f079a7dd64 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:49.916349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 657/1339] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:49.921621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc5823-434f-45a2-b3c4-53992e5f859a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:49.922033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc5823-434f-45a2-b3c4-53992e5f859a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:49.922162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc5823-434f-45a2-b3c4-53992e5f859a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:49.987270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d3bc5823-434f-45a2-b3c4-53992e5f859a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:49.988511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d3bc5823-434f-45a2-b3c4-53992e5f859a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:50.074134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:50.085012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 683/1340] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:50.372153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf94bf-7e10-4cac-a4ea-e4f079a7dd64 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:50.373668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d2cf94bf-7e10-4cac-a4ea-e4f079a7dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:50.422232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:50.477506 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf94bf-7e10-4cac-a4ea-e4f079a7dd64 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:50.550524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21f721-6bb8-498f-aa4a-6e5074a97b90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:50.551394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f721-6bb8-498f-aa4a-6e5074a97b90 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:50.551708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f721-6bb8-498f-aa4a-6e5074a97b90 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:50.551978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21f721-6bb8-498f-aa4a-6e5074a97b90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:50.553549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0e21f721-6bb8-498f-aa4a-6e5074a97b90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:50.650765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:50.667795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f721-6bb8-498f-aa4a-6e5074a97b90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:50.669273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e21f721-6bb8-498f-aa4a-6e5074a97b90 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:50.688567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 658/1341] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:53.767814 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeee92-accb-4f96-b3b5-2f1f8d14bdf0 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.768685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeee92-accb-4f96-b3b5-2f1f8d14bdf0 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.768685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faeee92-accb-4f96-b3b5-2f1f8d14bdf0 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.769741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 684/1342] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:53.775737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6b400-1b01-43c0-ab00-62e6d59b43db None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:53.776319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6b400-1b01-43c0-ab00-62e6d59b43db None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:53.776319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a6b400-1b01-43c0-ab00-62e6d59b43db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:53.843660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-22a6b400-1b01-43c0-ab00-62e6d59b43db None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:53.844794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-22a6b400-1b01-43c0-ab00-62e6d59b43db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:53.939179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 659/1343] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:43:54.244085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876594a-36a1-4605-84ff-3e5a22783c11 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.244482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876594a-36a1-4605-84ff-3e5a22783c11 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.244827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f876594a-36a1-4605-84ff-3e5a22783c11 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.246273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 685/1344] 10.222.0.25 () {54 vars in 964 bytes} [Tue Oct 4 08:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:54.253071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149657b-54e8-472f-b975-778f85311ec7 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.253359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149657b-54e8-472f-b975-778f85311ec7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.253634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149657b-54e8-472f-b975-778f85311ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.322817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:54.332458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-3149657b-54e8-472f-b975-778f85311ec7 None None] MFA Rules not processed for user `a269743c34bc48edaab5c0e3e78074c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:54.333673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3149657b-54e8-472f-b975-778f85311ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:54.409688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 660/1345] 10.222.0.25 () {58 vars in 1061 bytes} [Tue Oct 4 08:43:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:43:54.418290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876594a-36a1-4605-84ff-3e5a22783c11 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:43:54.419858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f876594a-36a1-4605-84ff-3e5a22783c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:54.558488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f876594a-36a1-4605-84ff-3e5a22783c11 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:43:54.643331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccb7799-99ef-4959-ad55-b02427ae19b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:43:54.643994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb7799-99ef-4959-ad55-b02427ae19b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:54.644269 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb7799-99ef-4959-ad55-b02427ae19b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:54.644543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccb7799-99ef-4959-ad55-b02427ae19b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:54.646195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8ccb7799-99ef-4959-ad55-b02427ae19b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:54.692279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:54.760633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb7799-99ef-4959-ad55-b02427ae19b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:43:54.762078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccb7799-99ef-4959-ad55-b02427ae19b7 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:43:54.781962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 686/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:43:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:43:59.811780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df4e93-89e2-44f7-8c42-c4ada16f873e None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.812282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df4e93-89e2-44f7-8c42-c4ada16f873e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.812375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df4e93-89e2-44f7-8c42-c4ada16f873e None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.814315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 661/1347] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:43:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:43:59.820186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2f646-64e3-48c5-8c31-a2f2a6786ff3 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:43:59.820730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2f646-64e3-48c5-8c31-a2f2a6786ff3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:43:59.820730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2f646-64e3-48c5-8c31-a2f2a6786ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:43:59.891371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b9d2f646-64e3-48c5-8c31-a2f2a6786ff3 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:43:59.892737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b9d2f646-64e3-48c5-8c31-a2f2a6786ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:43:59.988593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:43:59.990934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 687/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:00.276831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df4e93-89e2-44f7-8c42-c4ada16f873e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:00.278438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a0df4e93-89e2-44f7-8c42-c4ada16f873e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:00.384736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df4e93-89e2-44f7-8c42-c4ada16f873e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:00.434149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:00.459538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337296a6-6e0a-4729-bfbd-9f8f79a62753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:00.460140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337296a6-6e0a-4729-bfbd-9f8f79a62753 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:00.460416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337296a6-6e0a-4729-bfbd-9f8f79a62753 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:00.460687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337296a6-6e0a-4729-bfbd-9f8f79a62753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:00.462396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-337296a6-6e0a-4729-bfbd-9f8f79a62753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:00.567161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337296a6-6e0a-4729-bfbd-9f8f79a62753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:00.568882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337296a6-6e0a-4729-bfbd-9f8f79a62753 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:00.588987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 662/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:05.379551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b219b1-f951-469d-9243-b80947cbb58f None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.380354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b219b1-f951-469d-9243-b80947cbb58f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.382431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b219b1-f951-469d-9243-b80947cbb58f None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.390846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 688/1350] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:44:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:05.391543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd756254-5d8a-4e60-a048-da16c87a3ccf None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:05.391543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd756254-5d8a-4e60-a048-da16c87a3ccf None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:05.391543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd756254-5d8a-4e60-a048-da16c87a3ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:05.478980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bd756254-5d8a-4e60-a048-da16c87a3ccf None None] MFA Rules not processed for user `22aa2b6e4b854de4868b75cc9626b8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:05.480956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bd756254-5d8a-4e60-a048-da16c87a3ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:05.510135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:05.650898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 663/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:44:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:10.020243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e475d9f-c9d6-4075-97d3-7510f2994fb6 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.020603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e475d9f-c9d6-4075-97d3-7510f2994fb6 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.020603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e475d9f-c9d6-4075-97d3-7510f2994fb6 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.022065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 689/1352] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:10.026907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf008-60c2-43a0-ae4b-37830773411f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:10.027350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf008-60c2-43a0-ae4b-37830773411f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:10.027700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bdf008-60c2-43a0-ae4b-37830773411f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:10.106630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b3bdf008-60c2-43a0-ae4b-37830773411f None None] MFA Rules not processed for user `22aa2b6e4b854de4868b75cc9626b8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:10.107862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b3bdf008-60c2-43a0-ae4b-37830773411f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:10.182409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:10.227692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 664/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:44:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:11.510970 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217eb47-5512-4028-b143-5511e68330f4 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.511539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217eb47-5512-4028-b143-5511e68330f4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.511798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217eb47-5512-4028-b143-5511e68330f4 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.513227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 690/1354] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:11.518356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ea43d-dcdc-44cd-a382-a9b8823bf8fe None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:11.518770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ea43d-dcdc-44cd-a382-a9b8823bf8fe None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:11.518907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ea43d-dcdc-44cd-a382-a9b8823bf8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:11.605139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7f8ea43d-dcdc-44cd-a382-a9b8823bf8fe None None] MFA Rules not processed for user `22aa2b6e4b854de4868b75cc9626b8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:11.606349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7f8ea43d-dcdc-44cd-a382-a9b8823bf8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:11.713453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 665/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:44:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:44:15.278323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b6590-1398-48a3-8511-cb3b7144b4b1 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.278812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b6590-1398-48a3-8511-cb3b7144b4b1 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.278812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b6590-1398-48a3-8511-cb3b7144b4b1 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.280493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 691/1356] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:15.288402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839ddc9-7318-4571-a424-001ff0b6758c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.289626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839ddc9-7318-4571-a424-001ff0b6758c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.290174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839ddc9-7318-4571-a424-001ff0b6758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.330247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:15.363535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-c839ddc9-7318-4571-a424-001ff0b6758c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:15.365084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c839ddc9-7318-4571-a424-001ff0b6758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:15.477537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 666/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:15.782670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479feca1-0b08-4d45-9e39-735499bc301d None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.783138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479feca1-0b08-4d45-9e39-735499bc301d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.783414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479feca1-0b08-4d45-9e39-735499bc301d None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:15.784747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 692/1358] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 08:44:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:15.791289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c3e3f-e107-4736-b3f3-ed05f5d01b00 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:15.791760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c3e3f-e107-4736-b3f3-ed05f5d01b00 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:15.792144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c3e3f-e107-4736-b3f3-ed05f5d01b00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:16.003952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-cf8c3e3f-e107-4736-b3f3-ed05f5d01b00 None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:16.005353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cf8c3e3f-e107-4736-b3f3-ed05f5d01b00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:16.060488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:16.131345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 667/1359] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 08:44:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:16.139663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479feca1-0b08-4d45-9e39-735499bc301d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:16.141154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-479feca1-0b08-4d45-9e39-735499bc301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:16.301587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479feca1-0b08-4d45-9e39-735499bc301d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:16.394096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:16.443420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1c9d7-8974-4fb1-a4c0-c823df7b2659 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:16.444063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1c9d7-8974-4fb1-a4c0-c823df7b2659 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:16.444348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1c9d7-8974-4fb1-a4c0-c823df7b2659 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:16.444621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1c9d7-8974-4fb1-a4c0-c823df7b2659 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:16.446292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ebe1c9d7-8974-4fb1-a4c0-c823df7b2659 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:16.560935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1c9d7-8974-4fb1-a4c0-c823df7b2659 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:16.562898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1c9d7-8974-4fb1-a4c0-c823df7b2659 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:16.588254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 693/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:18.983207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102a678-2124-4963-8d0d-2420c0ab8ec0 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.983792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102a678-2124-4963-8d0d-2420c0ab8ec0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.983792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102a678-2124-4963-8d0d-2420c0ab8ec0 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:18.985679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 668/1361] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:18.991154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d308f37-e04f-4ffa-8942-49172cf647ea None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:18.991603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d308f37-e04f-4ffa-8942-49172cf647ea None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:18.991818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d308f37-e04f-4ffa-8942-49172cf647ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:19.058139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-4d308f37-e04f-4ffa-8942-49172cf647ea None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:19.059257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4d308f37-e04f-4ffa-8942-49172cf647ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:19.098066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:19.164720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 694/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:19.457527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102a678-2124-4963-8d0d-2420c0ab8ec0 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:19.459330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8102a678-2124-4963-8d0d-2420c0ab8ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:19.633337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102a678-2124-4963-8d0d-2420c0ab8ec0 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:19.643222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:19.752375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2a91c-9fd4-42de-a5db-701c332a1dbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:19.752985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2a91c-9fd4-42de-a5db-701c332a1dbf service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:19.753260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2a91c-9fd4-42de-a5db-701c332a1dbf service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:19.753529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2a91c-9fd4-42de-a5db-701c332a1dbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:19.755107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-15c2a91c-9fd4-42de-a5db-701c332a1dbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:19.849179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2a91c-9fd4-42de-a5db-701c332a1dbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:19.850756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2a91c-9fd4-42de-a5db-701c332a1dbf service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:19.868825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 669/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:22.452495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea4440-bdfd-4da8-8ecf-2a801ef5f795 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:22.453606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea4440-bdfd-4da8-8ecf-2a801ef5f795 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:22.453606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea4440-bdfd-4da8-8ecf-2a801ef5f795 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:22.455405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 695/1364] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:22.460336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6412f-c5a1-488a-b3ac-8d7540859a77 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:22.460769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6412f-c5a1-488a-b3ac-8d7540859a77 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:22.460860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad6412f-c5a1-488a-b3ac-8d7540859a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:22.477385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:22.528787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7ad6412f-c5a1-488a-b3ac-8d7540859a77 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:22.529989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7ad6412f-c5a1-488a-b3ac-8d7540859a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:22.643930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 670/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:22.929987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e67ea-e6cc-44bf-9667-ec4f43bcaf74 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:22.930342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e67ea-e6cc-44bf-9667-ec4f43bcaf74 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:22.930705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e67ea-e6cc-44bf-9667-ec4f43bcaf74 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:22.932510 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 696/1366] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 08:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:22.938728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782bf4-3224-47c5-862d-9cf75892671c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:22.939102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782bf4-3224-47c5-862d-9cf75892671c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:22.939444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b782bf4-3224-47c5-862d-9cf75892671c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:23.022919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-6b782bf4-3224-47c5-862d-9cf75892671c None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:23.024143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6b782bf4-3224-47c5-862d-9cf75892671c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:23.060541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:23.148087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 671/1367] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 08:44:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:23.156638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e67ea-e6cc-44bf-9667-ec4f43bcaf74 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:23.158182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b26e67ea-e6cc-44bf-9667-ec4f43bcaf74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:23.314002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e67ea-e6cc-44bf-9667-ec4f43bcaf74 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:23.336174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:23.412563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62791-08f5-46a0-ad49-f1d71f0b3aab None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:23.412907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62791-08f5-46a0-ad49-f1d71f0b3aab None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:23.413112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea62791-08f5-46a0-ad49-f1d71f0b3aab None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:23.414634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 672/1368] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:23.419471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514ad07-0b9d-4873-b021-9f383122e410 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:23.419798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514ad07-0b9d-4873-b021-9f383122e410 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:23.420076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514ad07-0b9d-4873-b021-9f383122e410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:23.434739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864dada-d746-4bdf-9324-17146487bc56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:23.435295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864dada-d746-4bdf-9324-17146487bc56 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:23.435607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864dada-d746-4bdf-9324-17146487bc56 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:23.435884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864dada-d746-4bdf-9324-17146487bc56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:23.437892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3864dada-d746-4bdf-9324-17146487bc56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:23.498035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-5514ad07-0b9d-4873-b021-9f383122e410 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:23.499269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5514ad07-0b9d-4873-b021-9f383122e410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:23.541530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864dada-d746-4bdf-9324-17146487bc56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:23.543132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864dada-d746-4bdf-9324-17146487bc56 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:23.563557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 697/1369] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:23.599750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:23.608584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 673/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:44:23.946757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4854cd-57c0-4d23-b058-7cee656b669e None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:23.946757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4854cd-57c0-4d23-b058-7cee656b669e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:23.948882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4854cd-57c0-4d23-b058-7cee656b669e None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:23.948882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 698/1371] 10.222.0.25 () {54 vars in 963 bytes} [Tue Oct 4 08:44:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:23.954845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159accf1-6da2-4387-a187-4c52eff78e78 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:23.955231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159accf1-6da2-4387-a187-4c52eff78e78 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:23.955601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159accf1-6da2-4387-a187-4c52eff78e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:24.046541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-159accf1-6da2-4387-a187-4c52eff78e78 None None] MFA Rules not processed for user `6f4df3626bdb4e3a88ce27eaabf4ca1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:24.047787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-159accf1-6da2-4387-a187-4c52eff78e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:24.127192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 674/1372] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Oct 4 08:44:23 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:24.134544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4854cd-57c0-4d23-b058-7cee656b669e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:24.136053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4d4854cd-57c0-4d23-b058-7cee656b669e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:24.166158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:24.241794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4854cd-57c0-4d23-b058-7cee656b669e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:24.333058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ecb35-5900-4465-ae80-fbddbdbfc0ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:24.333666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecb35-5900-4465-ae80-fbddbdbfc0ff service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:24.333947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecb35-5900-4465-ae80-fbddbdbfc0ff service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:24.334219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ecb35-5900-4465-ae80-fbddbdbfc0ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:24.335832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bc0ecb35-5900-4465-ae80-fbddbdbfc0ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:24.433459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:24.493398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ecb35-5900-4465-ae80-fbddbdbfc0ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:24.495298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ecb35-5900-4465-ae80-fbddbdbfc0ff service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:24.520447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 699/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:25.956200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807f7f-1c48-4b6a-a98d-e4b4e6869cce None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.956764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807f7f-1c48-4b6a-a98d-e4b4e6869cce None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.956764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c807f7f-1c48-4b6a-a98d-e4b4e6869cce None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:25.958077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 675/1374] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:25.963261 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49fed7-fc91-4c75-89f7-4369c67ba20e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:25.963705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49fed7-fc91-4c75-89f7-4369c67ba20e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:25.963847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49fed7-fc91-4c75-89f7-4369c67ba20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:26.029045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-4d49fed7-fc91-4c75-89f7-4369c67ba20e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:26.030253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4d49fed7-fc91-4c75-89f7-4369c67ba20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:26.135252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 700/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:26.435990 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c807f7f-1c48-4b6a-a98d-e4b4e6869cce None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:26.438175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5c807f7f-1c48-4b6a-a98d-e4b4e6869cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:26.528065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:26.593843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c807f7f-1c48-4b6a-a98d-e4b4e6869cce None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:26.714134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2723a734-b240-4542-a1b6-b3a87e6c2f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:26.714666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723a734-b240-4542-a1b6-b3a87e6c2f78 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:26.714940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723a734-b240-4542-a1b6-b3a87e6c2f78 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:26.715207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2723a734-b240-4542-a1b6-b3a87e6c2f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:26.716927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2723a734-b240-4542-a1b6-b3a87e6c2f78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:26.768825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:26.811733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723a734-b240-4542-a1b6-b3a87e6c2f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:26.813755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2723a734-b240-4542-a1b6-b3a87e6c2f78 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:26.833377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 676/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:29.178943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593002-1783-484c-8914-d39dee3db827 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:29.179501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593002-1783-484c-8914-d39dee3db827 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:29.179501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15593002-1783-484c-8914-d39dee3db827 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:29.181139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 701/1377] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:29.186499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6127-c5d7-4657-be13-c45adccee1e8 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:29.186949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6127-c5d7-4657-be13-c45adccee1e8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:29.187733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a6127-c5d7-4657-be13-c45adccee1e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:29.257180 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-509a6127-c5d7-4657-be13-c45adccee1e8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:29.259009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-509a6127-c5d7-4657-be13-c45adccee1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:29.359944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 677/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:29.646824 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15593002-1783-484c-8914-d39dee3db827 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:29.648572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-15593002-1783-484c-8914-d39dee3db827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:29.690028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:29.804406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15593002-1783-484c-8914-d39dee3db827 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:29.914108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:29.919747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442fa92-2a77-495c-b169-59efa4494405 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:29.920353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442fa92-2a77-495c-b169-59efa4494405 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:29.920629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442fa92-2a77-495c-b169-59efa4494405 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:29.920914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442fa92-2a77-495c-b169-59efa4494405 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:29.923000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f442fa92-2a77-495c-b169-59efa4494405 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:30.017401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442fa92-2a77-495c-b169-59efa4494405 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:30.018998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f442fa92-2a77-495c-b169-59efa4494405 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:30.038561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 702/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:32.333538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ded5de-710e-4993-b40e-e0b4f0295376 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:32.334057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ded5de-710e-4993-b40e-e0b4f0295376 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:32.334239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ded5de-710e-4993-b40e-e0b4f0295376 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:32.335424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 678/1380] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:32.340689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89079479-49c5-49e5-83d3-e7cc19f247db None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:32.341183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89079479-49c5-49e5-83d3-e7cc19f247db None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:32.341296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89079479-49c5-49e5-83d3-e7cc19f247db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:32.417992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-89079479-49c5-49e5-83d3-e7cc19f247db None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:32.419124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-89079479-49c5-49e5-83d3-e7cc19f247db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:32.484952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:32.517031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 703/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:32.807418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ded5de-710e-4993-b40e-e0b4f0295376 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:32.808943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-21ded5de-710e-4993-b40e-e0b4f0295376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:32.837644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:32.972736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ded5de-710e-4993-b40e-e0b4f0295376 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:33.070478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:33.085920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adf2d23-220e-4250-932a-859d2b0f95e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:33.086518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf2d23-220e-4250-932a-859d2b0f95e9 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:33.086843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf2d23-220e-4250-932a-859d2b0f95e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:33.087057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adf2d23-220e-4250-932a-859d2b0f95e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:33.088674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2adf2d23-220e-4250-932a-859d2b0f95e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:33.194853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf2d23-220e-4250-932a-859d2b0f95e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:33.196970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2adf2d23-220e-4250-932a-859d2b0f95e9 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:33.220646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 679/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:35.580793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4a05-d3b1-47e8-b458-ac36a3442b7b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:35.581453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4a05-d3b1-47e8-b458-ac36a3442b7b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:35.581453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2c4a05-d3b1-47e8-b458-ac36a3442b7b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:35.582561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 704/1383] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:35.589709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb6d50-bb11-4aff-87c4-8b7e253eb82e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:35.590159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb6d50-bb11-4aff-87c4-8b7e253eb82e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:35.590430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8eb6d50-bb11-4aff-87c4-8b7e253eb82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:35.668168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a8eb6d50-bb11-4aff-87c4-8b7e253eb82e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:35.669371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a8eb6d50-bb11-4aff-87c4-8b7e253eb82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:35.742060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:35.782555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 680/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:36.070039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c4a05-d3b1-47e8-b458-ac36a3442b7b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:36.072066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0e2c4a05-d3b1-47e8-b458-ac36a3442b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:36.240622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2c4a05-d3b1-47e8-b458-ac36a3442b7b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:36.303780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:36.364768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98657fa5-aac1-4cb4-9adf-41f5ed071726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:36.365374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98657fa5-aac1-4cb4-9adf-41f5ed071726 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:36.365650 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98657fa5-aac1-4cb4-9adf-41f5ed071726 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:36.365927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98657fa5-aac1-4cb4-9adf-41f5ed071726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:36.367542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-98657fa5-aac1-4cb4-9adf-41f5ed071726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:36.455365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98657fa5-aac1-4cb4-9adf-41f5ed071726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:36.457006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98657fa5-aac1-4cb4-9adf-41f5ed071726 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:36.475568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 705/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:38.937856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476f4b-f5e3-45dc-b8f5-ec755956ac8d None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:38.938762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476f4b-f5e3-45dc-b8f5-ec755956ac8d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:38.939127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62476f4b-f5e3-45dc-b8f5-ec755956ac8d None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:38.940531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 681/1386] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:38.946361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7e01f-a62f-48e1-910e-e19d7ac81682 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:38.946805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7e01f-a62f-48e1-910e-e19d7ac81682 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:38.946915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f7e01f-a62f-48e1-910e-e19d7ac81682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:39.012212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-46f7e01f-a62f-48e1-910e-e19d7ac81682 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:39.013411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-46f7e01f-a62f-48e1-910e-e19d7ac81682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:39.022900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:39.112897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 706/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:39.407094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62476f4b-f5e3-45dc-b8f5-ec755956ac8d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:39.408717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-62476f4b-f5e3-45dc-b8f5-ec755956ac8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:39.554398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62476f4b-f5e3-45dc-b8f5-ec755956ac8d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:39.610736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:39.677765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12919fd2-ccea-46f3-98bb-bd8db35bfc61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:39.678290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12919fd2-ccea-46f3-98bb-bd8db35bfc61 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:39.678597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12919fd2-ccea-46f3-98bb-bd8db35bfc61 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:39.678865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12919fd2-ccea-46f3-98bb-bd8db35bfc61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:39.680523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-12919fd2-ccea-46f3-98bb-bd8db35bfc61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:39.770384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12919fd2-ccea-46f3-98bb-bd8db35bfc61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:39.771999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12919fd2-ccea-46f3-98bb-bd8db35bfc61 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:39.789799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 682/1388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:44:39.956010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604088-8072-4764-9a83-a2d454b0af09 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:39.956555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604088-8072-4764-9a83-a2d454b0af09 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:39.956555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09604088-8072-4764-9a83-a2d454b0af09 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:39.957894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 707/1389] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:39.962993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f03f0-b06b-4c0c-b6ef-4228a81f9eca None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:39.963416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f03f0-b06b-4c0c-b6ef-4228a81f9eca None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:39.963602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f03f0-b06b-4c0c-b6ef-4228a81f9eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:40.034094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:40.038050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1f6f03f0-b06b-4c0c-b6ef-4228a81f9eca None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:40.038889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1f6f03f0-b06b-4c0c-b6ef-4228a81f9eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:40.150178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 683/1390] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:40.451162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5182-a72e-4e8f-8051-a12524e14e0d None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:40.451443 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5182-a72e-4e8f-8051-a12524e14e0d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:40.451759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ec5182-a72e-4e8f-8051-a12524e14e0d None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:40.453644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 708/1391] 10.222.0.25 () {54 vars in 962 bytes} [Tue Oct 4 08:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:40.458879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00d3ae-d891-4d17-8537-50581243c712 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:40.459233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00d3ae-d891-4d17-8537-50581243c712 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:40.459604 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00d3ae-d891-4d17-8537-50581243c712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:40.536127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-3f00d3ae-d891-4d17-8537-50581243c712 None None] MFA Rules not processed for user `4289134c7df04f96a5c4661165105109`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:40.537327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3f00d3ae-d891-4d17-8537-50581243c712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:40.608399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:40.613983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 684/1392] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Oct 4 08:44:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:44:40.623047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec5182-a72e-4e8f-8051-a12524e14e0d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:40.625083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-98ec5182-a72e-4e8f-8051-a12524e14e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:40.845855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ec5182-a72e-4e8f-8051-a12524e14e0d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:40.884829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:40.920753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754db50a-47da-4f66-af07-d0c9ce498784 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:40.921385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db50a-47da-4f66-af07-d0c9ce498784 service glance] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:40.921665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db50a-47da-4f66-af07-d0c9ce498784 service glance] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:40.921939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754db50a-47da-4f66-af07-d0c9ce498784 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:40.923552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-754db50a-47da-4f66-af07-d0c9ce498784 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:41.028398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754db50a-47da-4f66-af07-d0c9ce498784 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:41.029816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754db50a-47da-4f66-af07-d0c9ce498784 service glance] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:41.047717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 709/1393] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:41.905700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de16b8b-4b9c-43f4-a77b-9506c0e80ff3 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:41.906160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de16b8b-4b9c-43f4-a77b-9506c0e80ff3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:41.906269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de16b8b-4b9c-43f4-a77b-9506c0e80ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:41.971821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-2de16b8b-4b9c-43f4-a77b-9506c0e80ff3 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:41.973019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2de16b8b-4b9c-43f4-a77b-9506c0e80ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:42.062899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 685/1394] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:44:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:44:42.109022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f61e69-4095-4a24-8701-58d347941fd4 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.110518 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f61e69-4095-4a24-8701-58d347941fd4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.110518 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f61e69-4095-4a24-8701-58d347941fd4 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.110976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 710/1395] 10.222.0.25 () {54 vars in 943 bytes} [Tue Oct 4 08:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:42.117541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bb796-da82-4dd8-a929-e6c945790396 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.117831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bb796-da82-4dd8-a929-e6c945790396 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.118107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bb796-da82-4dd8-a929-e6c945790396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.134169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c28e8-4a88-47a0-9c71-93d39e348467 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.134532 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c28e8-4a88-47a0-9c71-93d39e348467 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.134900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1c28e8-4a88-47a0-9c71-93d39e348467 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.136250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 711/1396] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:44:42.141318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867d0f-f362-4da0-9d78-4394f4218728 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.141628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867d0f-f362-4da0-9d78-4394f4218728 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.141905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c867d0f-f362-4da0-9d78-4394f4218728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.196556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-381bb796-da82-4dd8-a929-e6c945790396 None None] MFA Rules not processed for user `590ac0c1da06460a8d32852f9c2e3609`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:42.197788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-381bb796-da82-4dd8-a929-e6c945790396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:42.206799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9c867d0f-f362-4da0-9d78-4394f4218728 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:42.208010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9c867d0f-f362-4da0-9d78-4394f4218728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:42.224945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.227037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.303752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 712/1397] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:44:42.306104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 686/1398] 10.222.0.25 () {58 vars in 1040 bytes} [Tue Oct 4 08:44:42 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:44:42.316446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c867d0f-f362-4da0-9d78-4394f4218728 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:42.317642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9c867d0f-f362-4da0-9d78-4394f4218728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:42.420117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c867d0f-f362-4da0-9d78-4394f4218728 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.467627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.521948 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475f0317-77e1-4d04-aaea-4d2035116f04 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.522572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0317-77e1-4d04-aaea-4d2035116f04 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.522855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0317-77e1-4d04-aaea-4d2035116f04 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.523119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475f0317-77e1-4d04-aaea-4d2035116f04 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.524793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-475f0317-77e1-4d04-aaea-4d2035116f04 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:42.593707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bb796-da82-4dd8-a929-e6c945790396 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:42.595067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-381bb796-da82-4dd8-a929-e6c945790396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:42.614682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f0317-77e1-4d04-aaea-4d2035116f04 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.616300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475f0317-77e1-4d04-aaea-4d2035116f04 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.624095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 713/1399] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:44:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:44:42.692439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bb796-da82-4dd8-a929-e6c945790396 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:42.742474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:42.817280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8bb34-f494-486a-9306-0e8e4acc5b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:42.821031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8bb34-f494-486a-9306-0e8e4acc5b74 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:42.821031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8bb34-f494-486a-9306-0e8e4acc5b74 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:42.821031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8bb34-f494-486a-9306-0e8e4acc5b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:42.821031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-97d8bb34-f494-486a-9306-0e8e4acc5b74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:42.915951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8bb34-f494-486a-9306-0e8e4acc5b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:42.917464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8bb34-f494-486a-9306-0e8e4acc5b74 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:42.935560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 687/1400] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:44:45.904969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daacf8-af47-4c43-9a9c-c0d2bda6b626 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:45.905570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daacf8-af47-4c43-9a9c-c0d2bda6b626 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:45.905570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4daacf8-af47-4c43-9a9c-c0d2bda6b626 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:45.907990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 714/1401] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:45.912152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa109b53-a5ee-45ba-a952-87b3552ba579 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:45.912597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa109b53-a5ee-45ba-a952-87b3552ba579 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:45.912803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa109b53-a5ee-45ba-a952-87b3552ba579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:45.989678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-fa109b53-a5ee-45ba-a952-87b3552ba579 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:45.990917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fa109b53-a5ee-45ba-a952-87b3552ba579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:45.994293 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:46.105286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 688/1402] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:46.397664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daacf8-af47-4c43-9a9c-c0d2bda6b626 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:46.399173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b4daacf8-af47-4c43-9a9c-c0d2bda6b626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:46.488500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:46.570088 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4daacf8-af47-4c43-9a9c-c0d2bda6b626 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:46.694419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7df211-1068-411f-977c-c35990310f84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:46.695027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df211-1068-411f-977c-c35990310f84 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:46.695308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df211-1068-411f-977c-c35990310f84 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:46.695621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7df211-1068-411f-977c-c35990310f84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:46.697218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-5c7df211-1068-411f-977c-c35990310f84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:46.742773 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:46.794429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7df211-1068-411f-977c-c35990310f84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:46.796861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7df211-1068-411f-977c-c35990310f84 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:46.815473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 715/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:44:49.162595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d8f4-ca4e-4606-8119-fb81ee8a66d6 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:49.163174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d8f4-ca4e-4606-8119-fb81ee8a66d6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:49.163174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d8f4-ca4e-4606-8119-fb81ee8a66d6 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:49.164571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 689/1404] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:49.169973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611091f7-4d55-4a72-9f89-cc7f25e3964b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:49.170403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611091f7-4d55-4a72-9f89-cc7f25e3964b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:49.170650 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611091f7-4d55-4a72-9f89-cc7f25e3964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:49.248990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-611091f7-4d55-4a72-9f89-cc7f25e3964b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:49.250297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-611091f7-4d55-4a72-9f89-cc7f25e3964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:49.355397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 716/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:49.648575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1d8f4-ca4e-4606-8119-fb81ee8a66d6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:49.652624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-94a1d8f4-ca4e-4606-8119-fb81ee8a66d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:49.801859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:49.815084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1d8f4-ca4e-4606-8119-fb81ee8a66d6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:49.942687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b6448-3e34-453b-8a2e-64d0761543f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:49.943596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b6448-3e34-453b-8a2e-64d0761543f6 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:49.943878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b6448-3e34-453b-8a2e-64d0761543f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:49.944147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b6448-3e34-453b-8a2e-64d0761543f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:49.945735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0f5b6448-3e34-453b-8a2e-64d0761543f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:50.046338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b6448-3e34-453b-8a2e-64d0761543f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:50.048939 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b6448-3e34-453b-8a2e-64d0761543f6 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:50.058849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:50.072772 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 690/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:44:52.437196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8ba71-28f2-4b81-8135-ec955c5c42d4 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:52.437764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8ba71-28f2-4b81-8135-ec955c5c42d4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:52.437959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba8ba71-28f2-4b81-8135-ec955c5c42d4 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:52.439388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 717/1407] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:44:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:44:52.444940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04c5d-c180-4580-9e1c-4230b37a4b59 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:52.445373 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04c5d-c180-4580-9e1c-4230b37a4b59 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:52.445467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e04c5d-c180-4580-9e1c-4230b37a4b59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:52.517970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-93e04c5d-c180-4580-9e1c-4230b37a4b59 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:44:52.519206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-93e04c5d-c180-4580-9e1c-4230b37a4b59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:52.636607 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 691/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:44:52.933427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8ba71-28f2-4b81-8135-ec955c5c42d4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:44:52.934932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bba8ba71-28f2-4b81-8135-ec955c5c42d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:52.956292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:53.151595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba8ba71-28f2-4b81-8135-ec955c5c42d4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:44:53.260690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:44:53.289784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef42fa4-a4d2-43e0-b2ae-49387a3b722c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:44:53.290952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42fa4-a4d2-43e0-b2ae-49387a3b722c service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:44:53.291694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42fa4-a4d2-43e0-b2ae-49387a3b722c service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:44:53.292311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef42fa4-a4d2-43e0-b2ae-49387a3b722c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:44:53.294715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6ef42fa4-a4d2-43e0-b2ae-49387a3b722c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:44:53.400598 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42fa4-a4d2-43e0-b2ae-49387a3b722c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:44:53.402186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef42fa4-a4d2-43e0-b2ae-49387a3b722c service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:44:53.426232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 718/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:44:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:02.635004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=68 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:03.423497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=54 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:07.505481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2fe24-08f5-415d-9c3c-9cc251940d13 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:07.506020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2fe24-08f5-415d-9c3c-9cc251940d13 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:07.506020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb2fe24-08f5-415d-9c3c-9cc251940d13 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:07.507602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 692/1410] 10.222.0.25 () {54 vars in 918 bytes} [Tue Oct 4 08:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:07.512549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f099ae-896c-4a91-a457-9ed2ab521732 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:07.512957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f099ae-896c-4a91-a457-9ed2ab521732 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:07.513093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f099ae-896c-4a91-a457-9ed2ab521732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:07.586344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-94f099ae-896c-4a91-a457-9ed2ab521732 None None] MFA Rules not processed for user `22aa2b6e4b854de4868b75cc9626b8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:07.587558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-94f099ae-896c-4a91-a457-9ed2ab521732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:07.695291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 719/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 4 08:45:07 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:07.709494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823b09a-32fc-46bb-9859-f8b6fdf4a0ed None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:07.709780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823b09a-32fc-46bb-9859-f8b6fdf4a0ed None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:07.710059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8823b09a-32fc-46bb-9859-f8b6fdf4a0ed None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:07.711451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 693/1412] 10.222.0.25 () {54 vars in 918 bytes} [Tue Oct 4 08:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:07.716094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4645cce-d861-4ee1-9b95-5c730c9d23e2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:07.716382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4645cce-d861-4ee1-9b95-5c730c9d23e2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:07.716655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4645cce-d861-4ee1-9b95-5c730c9d23e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:07.788704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:07.791126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b4645cce-d861-4ee1-9b95-5c730c9d23e2 None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:07.792368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b4645cce-d861-4ee1-9b95-5c730c9d23e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:07.915730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 720/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Oct 4 08:45:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:10.482215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91315257-dfcb-49e9-9cf2-da4f92c0fa6d None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:10.483276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91315257-dfcb-49e9-9cf2-da4f92c0fa6d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:10.483276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91315257-dfcb-49e9-9cf2-da4f92c0fa6d None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:10.484656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:10.489998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a74e44-e9b8-4ebf-be55-2f2ca3b5d0c5 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:10.490394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a74e44-e9b8-4ebf-be55-2f2ca3b5d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:10.490543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a74e44-e9b8-4ebf-be55-2f2ca3b5d0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:10.554869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c3a74e44-e9b8-4ebf-be55-2f2ca3b5d0c5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:10.556078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c3a74e44-e9b8-4ebf-be55-2f2ca3b5d0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:10.610191 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:10.649652 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:10.936230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91315257-dfcb-49e9-9cf2-da4f92c0fa6d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:10.937752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-91315257-dfcb-49e9-9cf2-da4f92c0fa6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:11.081377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91315257-dfcb-49e9-9cf2-da4f92c0fa6d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:11.151627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:11.191349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c25f5f-5971-43ba-a970-aec7e3d1a117 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:11.191990 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25f5f-5971-43ba-a970-aec7e3d1a117 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:11.192270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25f5f-5971-43ba-a970-aec7e3d1a117 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:11.192541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c25f5f-5971-43ba-a970-aec7e3d1a117 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:11.194374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-96c25f5f-5971-43ba-a970-aec7e3d1a117 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:11.284781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c25f5f-5971-43ba-a970-aec7e3d1a117 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:11.286376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c25f5f-5971-43ba-a970-aec7e3d1a117 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:11.304487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 695/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:12.442751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac3354-6ff0-4a0d-ac69-64c48f0aab33 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:12.443581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac3354-6ff0-4a0d-ac69-64c48f0aab33 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:12.443581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac3354-6ff0-4a0d-ac69-64c48f0aab33 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:12.444977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:12.451114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847f9d-33a5-400e-ac69-3abca5770bf2 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:12.452101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847f9d-33a5-400e-ac69-3abca5770bf2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:12.452199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c847f9d-33a5-400e-ac69-3abca5770bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:12.526219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-5c847f9d-33a5-400e-ac69-3abca5770bf2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:12.527433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5c847f9d-33a5-400e-ac69-3abca5770bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:12.553971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:12.624242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:12.779210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac3354-6ff0-4a0d-ac69-64c48f0aab33 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:12.781367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b4ac3354-6ff0-4a0d-ac69-64c48f0aab33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:12.923802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac3354-6ff0-4a0d-ac69-64c48f0aab33 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:12.963460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:13.033782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f35caa7-7f44-4634-9693-b67ef8b0c3c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:13.034308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35caa7-7f44-4634-9693-b67ef8b0c3c9 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:13.034586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35caa7-7f44-4634-9693-b67ef8b0c3c9 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:13.034857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f35caa7-7f44-4634-9693-b67ef8b0c3c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:13.036460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4f35caa7-7f44-4634-9693-b67ef8b0c3c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:13.121994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35caa7-7f44-4634-9693-b67ef8b0c3c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:13.124211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f35caa7-7f44-4634-9693-b67ef8b0c3c9 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:13.142140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 723/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:14.266561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677316-9a87-4388-a3a6-28e2483ad645 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:14.267101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677316-9a87-4388-a3a6-28e2483ad645 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:14.267101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677316-9a87-4388-a3a6-28e2483ad645 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:14.268501 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:14.275140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae56f-61e6-415a-a1f7-be6f148f5b17 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:14.275634 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae56f-61e6-415a-a1f7-be6f148f5b17 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:14.275883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aae56f-61e6-415a-a1f7-be6f148f5b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:14.330095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:14.351867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-67aae56f-61e6-415a-a1f7-be6f148f5b17 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:14.353100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-67aae56f-61e6-415a-a1f7-be6f148f5b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:14.447675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:14.600538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677316-9a87-4388-a3a6-28e2483ad645 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:14.602030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e4677316-9a87-4388-a3a6-28e2483ad645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:14.743827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677316-9a87-4388-a3a6-28e2483ad645 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:14.755656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:14.855247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33364a4f-0657-4b5c-a3e9-4be2bccba4cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:14.855815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364a4f-0657-4b5c-a3e9-4be2bccba4cc service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:14.856093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364a4f-0657-4b5c-a3e9-4be2bccba4cc service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:14.856370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33364a4f-0657-4b5c-a3e9-4be2bccba4cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:14.857988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-33364a4f-0657-4b5c-a3e9-4be2bccba4cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:14.946252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364a4f-0657-4b5c-a3e9-4be2bccba4cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:14.947908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33364a4f-0657-4b5c-a3e9-4be2bccba4cc service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:14.965966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 698/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:16.081488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd109970-e304-4c42-b27d-86ffcb5ac287 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.081984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd109970-e304-4c42-b27d-86ffcb5ac287 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.082157 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd109970-e304-4c42-b27d-86ffcb5ac287 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.083449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:16.089835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebd39e-52e5-4c8b-a158-fad29e1a1765 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.090283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebd39e-52e5-4c8b-a158-fad29e1a1765 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.090397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebd39e-52e5-4c8b-a158-fad29e1a1765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.109692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:16.165838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bcebd39e-52e5-4c8b-a158-fad29e1a1765 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:16.167048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bcebd39e-52e5-4c8b-a158-fad29e1a1765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:16.263382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:16.412147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd109970-e304-4c42-b27d-86ffcb5ac287 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:16.413655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bd109970-e304-4c42-b27d-86ffcb5ac287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:16.523681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:16.557954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd109970-e304-4c42-b27d-86ffcb5ac287 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:16.668527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941eccf-aa93-4418-9047-54862f9112b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:16.669058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941eccf-aa93-4418-9047-54862f9112b6 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:16.669335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941eccf-aa93-4418-9047-54862f9112b6 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:16.669606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941eccf-aa93-4418-9047-54862f9112b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:16.671818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-5941eccf-aa93-4418-9047-54862f9112b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:16.745407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:16.758583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941eccf-aa93-4418-9047-54862f9112b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:16.769757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941eccf-aa93-4418-9047-54862f9112b6 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:16.777488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 726/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:17.886861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a3d10-d49d-40ac-8195-521c108b7c93 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:17.887394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a3d10-d49d-40ac-8195-521c108b7c93 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:17.887394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a3d10-d49d-40ac-8195-521c108b7c93 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:17.888707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:17.895022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf5803-076c-4280-8a6f-caa95c206225 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:17.895442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf5803-076c-4280-8a6f-caa95c206225 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:17.895590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcf5803-076c-4280-8a6f-caa95c206225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:17.969890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9fcf5803-076c-4280-8a6f-caa95c206225 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:17.971079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9fcf5803-076c-4280-8a6f-caa95c206225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:18.064236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:18.213956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a3d10-d49d-40ac-8195-521c108b7c93 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:18.215456 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b11a3d10-d49d-40ac-8195-521c108b7c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:18.298730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:18.359906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a3d10-d49d-40ac-8195-521c108b7c93 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:18.470712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f67521-357a-4044-b660-d241daccd424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:18.471238 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67521-357a-4044-b660-d241daccd424 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:18.471536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67521-357a-4044-b660-d241daccd424 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:18.471831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f67521-357a-4044-b660-d241daccd424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:18.473415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d2f67521-357a-4044-b660-d241daccd424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:18.520499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:18.560955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f67521-357a-4044-b660-d241daccd424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:18.562521 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f67521-357a-4044-b660-d241daccd424 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:18.580894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 701/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:19.671963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c10c7f-2db1-44fb-8e27-b550f054da0c None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:19.672525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c10c7f-2db1-44fb-8e27-b550f054da0c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:19.672525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c10c7f-2db1-44fb-8e27-b550f054da0c None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:19.673843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:19.679937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4f5b1-7e40-4925-8386-8fedf36ba65e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:19.680366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4f5b1-7e40-4925-8386-8fedf36ba65e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:19.680557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4f5b1-7e40-4925-8386-8fedf36ba65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:19.755622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7bf4f5b1-7e40-4925-8386-8fedf36ba65e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:19.756846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7bf4f5b1-7e40-4925-8386-8fedf36ba65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:19.850925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:20.001182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c10c7f-2db1-44fb-8e27-b550f054da0c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:20.002704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-31c10c7f-2db1-44fb-8e27-b550f054da0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:20.050506 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:20.145550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c10c7f-2db1-44fb-8e27-b550f054da0c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:20.254632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6595009-0f76-4fe7-ad40-99d026a45abe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:20.255237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6595009-0f76-4fe7-ad40-99d026a45abe service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:20.255541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6595009-0f76-4fe7-ad40-99d026a45abe service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:20.255819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6595009-0f76-4fe7-ad40-99d026a45abe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:20.257392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f6595009-0f76-4fe7-ad40-99d026a45abe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:20.264135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:20.346442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6595009-0f76-4fe7-ad40-99d026a45abe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:20.348052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6595009-0f76-4fe7-ad40-99d026a45abe service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:20.365122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 729/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:21.459272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add4a0-6595-4883-a6e9-1cfb4eda7631 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:21.459272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add4a0-6595-4883-a6e9-1cfb4eda7631 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:21.459778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3add4a0-6595-4883-a6e9-1cfb4eda7631 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:21.461030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:21.467367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02ab9b-05d4-4c6a-9ab2-519b67621977 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:21.473676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02ab9b-05d4-4c6a-9ab2-519b67621977 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:21.473676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba02ab9b-05d4-4c6a-9ab2-519b67621977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:21.541857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ba02ab9b-05d4-4c6a-9ab2-519b67621977 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:21.543066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ba02ab9b-05d4-4c6a-9ab2-519b67621977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:21.610679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:21.637536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:21.786895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add4a0-6595-4883-a6e9-1cfb4eda7631 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:21.788480 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f3add4a0-6595-4883-a6e9-1cfb4eda7631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:21.805636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:21.932161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3add4a0-6595-4883-a6e9-1cfb4eda7631 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:22.018006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:22.042292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36d3cc-6dce-46d3-a167-3a2e06926d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:22.042827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36d3cc-6dce-46d3-a167-3a2e06926d88 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:22.043099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36d3cc-6dce-46d3-a167-3a2e06926d88 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:22.043369 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36d3cc-6dce-46d3-a167-3a2e06926d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:22.044960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fc36d3cc-6dce-46d3-a167-3a2e06926d88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:22.132557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36d3cc-6dce-46d3-a167-3a2e06926d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:22.134128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36d3cc-6dce-46d3-a167-3a2e06926d88 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:22.152084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 704/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:23.230380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691f51b-2d3d-4fba-9218-49340c34d505 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:23.230926 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691f51b-2d3d-4fba-9218-49340c34d505 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:23.230926 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691f51b-2d3d-4fba-9218-49340c34d505 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:23.232305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:23.238577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa2fe8-6fec-45e0-bcb6-7376c0c27a00 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:23.239011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa2fe8-6fec-45e0-bcb6-7376c0c27a00 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:23.239123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa2fe8-6fec-45e0-bcb6-7376c0c27a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:23.315297 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-33aa2fe8-6fec-45e0-bcb6-7376c0c27a00 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:23.316530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-33aa2fe8-6fec-45e0-bcb6-7376c0c27a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:23.356874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:23.410148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:23.558756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691f51b-2d3d-4fba-9218-49340c34d505 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:23.560240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0691f51b-2d3d-4fba-9218-49340c34d505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:23.700869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691f51b-2d3d-4fba-9218-49340c34d505 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:23.753642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:23.810106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aaca18-9e0e-4597-a06a-cf282063e3ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:23.810632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaca18-9e0e-4597-a06a-cf282063e3ef service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:23.810909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaca18-9e0e-4597-a06a-cf282063e3ef service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:23.811175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aaca18-9e0e-4597-a06a-cf282063e3ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:23.813371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f5aaca18-9e0e-4597-a06a-cf282063e3ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:23.900303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaca18-9e0e-4597-a06a-cf282063e3ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:23.901877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aaca18-9e0e-4597-a06a-cf282063e3ef service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:23.918991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 732/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:25.032336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdc010-46f3-4432-a64f-8a96dbeecdc5 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:25.032919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdc010-46f3-4432-a64f-8a96dbeecdc5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:25.032919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdc010-46f3-4432-a64f-8a96dbeecdc5 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:25.034226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:45:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:25.040614 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2daa-f372-4316-94da-b2f2095b1208 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:25.041053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2daa-f372-4316-94da-b2f2095b1208 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:25.041159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350e2daa-f372-4316-94da-b2f2095b1208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:25.114907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-350e2daa-f372-4316-94da-b2f2095b1208 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:25.116164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-350e2daa-f372-4316-94da-b2f2095b1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:25.118126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:25.210923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:25.362360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdc010-46f3-4432-a64f-8a96dbeecdc5 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:25.363852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bbcdc010-46f3-4432-a64f-8a96dbeecdc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:25.504928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdc010-46f3-4432-a64f-8a96dbeecdc5 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:25.530718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:25.617218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2649af7-2bcc-45e2-82c9-a0fa1a83a701 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:25.617762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649af7-2bcc-45e2-82c9-a0fa1a83a701 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:25.618043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649af7-2bcc-45e2-82c9-a0fa1a83a701 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:25.618317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2649af7-2bcc-45e2-82c9-a0fa1a83a701 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:25.619930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d2649af7-2bcc-45e2-82c9-a0fa1a83a701 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:25.706642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2649af7-2bcc-45e2-82c9-a0fa1a83a701 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:25.708255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2649af7-2bcc-45e2-82c9-a0fa1a83a701 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:25.726046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 707/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:27.768352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a84f8c-9ab2-47bf-9add-4f496e9a1a86 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:27.768943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a84f8c-9ab2-47bf-9add-4f496e9a1a86 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:27.768943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a84f8c-9ab2-47bf-9add-4f496e9a1a86 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:27.770228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:27.775442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86530de-4144-4fc5-9505-de2085204a58 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:27.775922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86530de-4144-4fc5-9505-de2085204a58 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:27.776052 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86530de-4144-4fc5-9505-de2085204a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:27.818491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:27.843699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-c86530de-4144-4fc5-9505-de2085204a58 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:27.844824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c86530de-4144-4fc5-9505-de2085204a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:27.937755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:28.219818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a84f8c-9ab2-47bf-9add-4f496e9a1a86 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:28.221408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c0a84f8c-9ab2-47bf-9add-4f496e9a1a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:28.323543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a84f8c-9ab2-47bf-9add-4f496e9a1a86 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:28.355973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:28.395647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06301e8-543c-4cdc-84c4-1257cc15f905 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:28.396287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06301e8-543c-4cdc-84c4-1257cc15f905 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:28.396569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06301e8-543c-4cdc-84c4-1257cc15f905 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:28.396844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06301e8-543c-4cdc-84c4-1257cc15f905 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:28.398458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d06301e8-543c-4cdc-84c4-1257cc15f905 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:28.506076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06301e8-543c-4cdc-84c4-1257cc15f905 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:28.507423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06301e8-543c-4cdc-84c4-1257cc15f905 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:28.525258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 735/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:30.809577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46253f9a-e6d6-4f2e-9a36-a16f3f053fc9 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:30.810141 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46253f9a-e6d6-4f2e-9a36-a16f3f053fc9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:30.810141 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46253f9a-e6d6-4f2e-9a36-a16f3f053fc9 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:30.812195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:30.817325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724d69a-103b-423a-9364-d199ecf20443 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:30.817725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724d69a-103b-423a-9364-d199ecf20443 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:30.817878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724d69a-103b-423a-9364-d199ecf20443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:30.882363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-1724d69a-103b-423a-9364-d199ecf20443 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:30.883495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1724d69a-103b-423a-9364-d199ecf20443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:30.896084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:30.977079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:31.263832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46253f9a-e6d6-4f2e-9a36-a16f3f053fc9 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:31.265396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-46253f9a-e6d6-4f2e-9a36-a16f3f053fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:31.369377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46253f9a-e6d6-4f2e-9a36-a16f3f053fc9 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:31.382682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:31.442560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48248d4b-152a-4859-b95f-db7aa05d53f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:31.443162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48248d4b-152a-4859-b95f-db7aa05d53f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:31.443732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48248d4b-152a-4859-b95f-db7aa05d53f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:31.444010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48248d4b-152a-4859-b95f-db7aa05d53f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:31.445581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-48248d4b-152a-4859-b95f-db7aa05d53f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:31.550560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48248d4b-152a-4859-b95f-db7aa05d53f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:31.551932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48248d4b-152a-4859-b95f-db7aa05d53f1 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:31.570408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 710/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:34.076231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e07c-f977-499f-ac11-3487aa199c4e None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:34.077253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e07c-f977-499f-ac11-3487aa199c4e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:34.077347 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d58e07c-f977-499f-ac11-3487aa199c4e None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:34.078660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:34.083966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98ad2c-34a2-48f6-ab5b-4ff4a0266876 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:34.087461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98ad2c-34a2-48f6-ab5b-4ff4a0266876 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:34.087461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98ad2c-34a2-48f6-ab5b-4ff4a0266876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:34.133465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:34.151502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-de98ad2c-34a2-48f6-ab5b-4ff4a0266876 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:34.152772 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-de98ad2c-34a2-48f6-ab5b-4ff4a0266876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:34.247001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:34.530482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58e07c-f977-499f-ac11-3487aa199c4e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:34.532067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9d58e07c-f977-499f-ac11-3487aa199c4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:34.633947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d58e07c-f977-499f-ac11-3487aa199c4e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:34.673247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:34.704866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0af847-616c-4a0d-bf56-80013fc18e53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:34.705460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af847-616c-4a0d-bf56-80013fc18e53 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:34.705738 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af847-616c-4a0d-bf56-80013fc18e53 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:34.706008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0af847-616c-4a0d-bf56-80013fc18e53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:34.707644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7f0af847-616c-4a0d-bf56-80013fc18e53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:34.813141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0af847-616c-4a0d-bf56-80013fc18e53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:34.814485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0af847-616c-4a0d-bf56-80013fc18e53 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:34.831837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 738/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:37.095016 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1e896-c22f-451e-a6cd-cf3334357e13 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:37.098777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1e896-c22f-451e-a6cd-cf3334357e13 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:37.098777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1e896-c22f-451e-a6cd-cf3334357e13 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:37.098777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:37.102251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3d0bc-037b-42b3-a48d-cef18b8dfda1 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:37.102673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3d0bc-037b-42b3-a48d-cef18b8dfda1 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:37.102810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b3d0bc-037b-42b3-a48d-cef18b8dfda1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:37.168316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c2b3d0bc-037b-42b3-a48d-cef18b8dfda1 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:37.169521 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c2b3d0bc-037b-42b3-a48d-cef18b8dfda1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:37.191275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:37.265837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:37.552462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1e896-c22f-451e-a6cd-cf3334357e13 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:37.553977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7ab1e896-c22f-451e-a6cd-cf3334357e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:37.658372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1e896-c22f-451e-a6cd-cf3334357e13 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:37.678227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:37.730397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5b5aa-b70b-4a8f-8c94-e2899e93d1cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:37.730999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5b5aa-b70b-4a8f-8c94-e2899e93d1cd service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:37.731344 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5b5aa-b70b-4a8f-8c94-e2899e93d1cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:37.731648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5b5aa-b70b-4a8f-8c94-e2899e93d1cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:37.733271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-86d5b5aa-b70b-4a8f-8c94-e2899e93d1cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:37.840655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5b5aa-b70b-4a8f-8c94-e2899e93d1cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:37.841992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d5b5aa-b70b-4a8f-8c94-e2899e93d1cd service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:37.859593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 713/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:40.041996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1371f-a6ee-4b5d-b69e-24a382dc1db2 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:40.042538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1371f-a6ee-4b5d-b69e-24a382dc1db2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:40.042656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1371f-a6ee-4b5d-b69e-24a382dc1db2 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:40.043959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:40.050073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1000c-4439-4e72-9a93-a8110914c0fb None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:40.050532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1000c-4439-4e72-9a93-a8110914c0fb None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:40.050635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1000c-4439-4e72-9a93-a8110914c0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:40.113456 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:40.116385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7cd1000c-4439-4e72-9a93-a8110914c0fb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:40.117580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7cd1000c-4439-4e72-9a93-a8110914c0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:40.212676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:40.497019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1371f-a6ee-4b5d-b69e-24a382dc1db2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:40.498563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-71d1371f-a6ee-4b5d-b69e-24a382dc1db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:40.600181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d1371f-a6ee-4b5d-b69e-24a382dc1db2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:40.647110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:40.670536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9701ae-9cc4-4a7f-a483-d731dfc399b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:40.671243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9701ae-9cc4-4a7f-a483-d731dfc399b7 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:40.671527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9701ae-9cc4-4a7f-a483-d731dfc399b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:40.671821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9701ae-9cc4-4a7f-a483-d731dfc399b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:40.673391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-af9701ae-9cc4-4a7f-a483-d731dfc399b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:40.778087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9701ae-9cc4-4a7f-a483-d731dfc399b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:40.779419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9701ae-9cc4-4a7f-a483-d731dfc399b7 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:40.797961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 741/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:42.988732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464fd03-d5f2-4af1-a0a6-bbbc458e7fd1 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:42.989262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464fd03-d5f2-4af1-a0a6-bbbc458e7fd1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:42.989262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464fd03-d5f2-4af1-a0a6-bbbc458e7fd1 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:42.990713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:42.996132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa2207-9a10-48d0-828a-75d30209111b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:42.996589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa2207-9a10-48d0-828a-75d30209111b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:42.996685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa2207-9a10-48d0-828a-75d30209111b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:43.060042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-6eaa2207-9a10-48d0-828a-75d30209111b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:43.061235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6eaa2207-9a10-48d0-828a-75d30209111b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:43.090144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:43.157126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:43.442476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464fd03-d5f2-4af1-a0a6-bbbc458e7fd1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:43.444292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f464fd03-d5f2-4af1-a0a6-bbbc458e7fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:43.545066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464fd03-d5f2-4af1-a0a6-bbbc458e7fd1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:43.573650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:43.619160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ff2209-9b17-487a-95ad-71ad0bac0465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:43.619785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff2209-9b17-487a-95ad-71ad0bac0465 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:43.620062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff2209-9b17-487a-95ad-71ad0bac0465 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:43.620331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ff2209-9b17-487a-95ad-71ad0bac0465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:43.621881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-58ff2209-9b17-487a-95ad-71ad0bac0465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:43.731035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff2209-9b17-487a-95ad-71ad0bac0465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:43.733048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ff2209-9b17-487a-95ad-71ad0bac0465 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:43.751560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 716/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:45.965628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691e9d0-81ce-4544-a7f9-3de916825d98 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:45.966195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691e9d0-81ce-4544-a7f9-3de916825d98 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:45.966195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8691e9d0-81ce-4544-a7f9-3de916825d98 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:45.967616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:45.973108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6fbd1-fda1-4e1a-8b8a-6f077195aeb5 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:45.973534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6fbd1-fda1-4e1a-8b8a-6f077195aeb5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:45.973643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6fbd1-fda1-4e1a-8b8a-6f077195aeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:46.039639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-5ec6fbd1-fda1-4e1a-8b8a-6f077195aeb5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:46.040844 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5ec6fbd1-fda1-4e1a-8b8a-6f077195aeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:46.049465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:46.136469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:46.422843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691e9d0-81ce-4544-a7f9-3de916825d98 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:46.424386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8691e9d0-81ce-4544-a7f9-3de916825d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:46.533054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8691e9d0-81ce-4544-a7f9-3de916825d98 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:46.584897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:46.603422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9447743-5afa-4110-95dd-656770af965c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:46.604057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9447743-5afa-4110-95dd-656770af965c service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:46.604336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9447743-5afa-4110-95dd-656770af965c service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:46.604601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9447743-5afa-4110-95dd-656770af965c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:46.606186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b9447743-5afa-4110-95dd-656770af965c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:46.710613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9447743-5afa-4110-95dd-656770af965c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:46.712101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9447743-5afa-4110-95dd-656770af965c service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:46.731326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 744/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:48.920396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1609-fdc6-4383-ade6-4ca6ac83047b None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.920907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1609-fdc6-4383-ade6-4ca6ac83047b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.920907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c1609-fdc6-4383-ade6-4ca6ac83047b None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.922237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:48.927437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bf407-b72b-41ae-949d-2daf19a730a3 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:48.927855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bf407-b72b-41ae-949d-2daf19a730a3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:48.928011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060bf407-b72b-41ae-949d-2daf19a730a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:48.991885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-060bf407-b72b-41ae-949d-2daf19a730a3 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:48.993092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-060bf407-b72b-41ae-949d-2daf19a730a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:49.030144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:49.086920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:49.369314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1609-fdc6-4383-ade6-4ca6ac83047b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:49.370868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2f1c1609-fdc6-4383-ade6-4ca6ac83047b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:49.473008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c1609-fdc6-4383-ade6-4ca6ac83047b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:49.509908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:49.545534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0e8d2-aa36-4c6d-89a7-63a33801a744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:49.546135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e8d2-aa36-4c6d-89a7-63a33801a744 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:49.546409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e8d2-aa36-4c6d-89a7-63a33801a744 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:49.546679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0e8d2-aa36-4c6d-89a7-63a33801a744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:49.548282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-63f0e8d2-aa36-4c6d-89a7-63a33801a744 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:49.656560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0e8d2-aa36-4c6d-89a7-63a33801a744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:49.657921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0e8d2-aa36-4c6d-89a7-63a33801a744 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:49.676480 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 719/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:51.831069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b6503-f458-450b-91bb-b81e916ada46 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.831647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b6503-f458-450b-91bb-b81e916ada46 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.831647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9b6503-f458-450b-91bb-b81e916ada46 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.832991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:51.838239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d33a-67af-46b7-bc4a-a486aea50e48 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:51.838681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d33a-67af-46b7-bc4a-a486aea50e48 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:51.838812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d33a-67af-46b7-bc4a-a486aea50e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:51.905341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-98c5d33a-67af-46b7-bc4a-a486aea50e48 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:51.906459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-98c5d33a-67af-46b7-bc4a-a486aea50e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:51.924371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:52.000624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:52.297383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b6503-f458-450b-91bb-b81e916ada46 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:52.298923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6f9b6503-f458-450b-91bb-b81e916ada46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:52.403729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9b6503-f458-450b-91bb-b81e916ada46 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:52.470220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:52.476561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3e6ee-ae07-4d27-a3d9-f2fe8464c446 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:52.477164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3e6ee-ae07-4d27-a3d9-f2fe8464c446 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:52.477444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3e6ee-ae07-4d27-a3d9-f2fe8464c446 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:52.477717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3e6ee-ae07-4d27-a3d9-f2fe8464c446 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:52.479315 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8ce3e6ee-ae07-4d27-a3d9-f2fe8464c446 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:52.584755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3e6ee-ae07-4d27-a3d9-f2fe8464c446 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:52.586112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3e6ee-ae07-4d27-a3d9-f2fe8464c446 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:52.603752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 747/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:45:54.754965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9207aa7-ddd6-42b4-adc3-41a04f800a81 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:54.755645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9207aa7-ddd6-42b4-adc3-41a04f800a81 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:54.755645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9207aa7-ddd6-42b4-adc3-41a04f800a81 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:54.757117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:45:54.762389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9768e-a195-4288-b676-4d938b34a55d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:54.762801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9768e-a195-4288-b676-4d938b34a55d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:54.762922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e9768e-a195-4288-b676-4d938b34a55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:54.829080 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c4e9768e-a195-4288-b676-4d938b34a55d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:45:54.830278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c4e9768e-a195-4288-b676-4d938b34a55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:54.878375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:54.925175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:45:55.212499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9207aa7-ddd6-42b4-adc3-41a04f800a81 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:45:55.214038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f9207aa7-ddd6-42b4-adc3-41a04f800a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:55.314767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9207aa7-ddd6-42b4-adc3-41a04f800a81 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:45:55.361709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:45:55.386993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51c42b-f5b7-493e-ae47-ebd772e1008f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:45:55.387615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c42b-f5b7-493e-ae47-ebd772e1008f service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:45:55.387893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c42b-f5b7-493e-ae47-ebd772e1008f service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:45:55.388164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51c42b-f5b7-493e-ae47-ebd772e1008f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:45:55.390307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4f51c42b-f5b7-493e-ae47-ebd772e1008f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:45:55.496958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51c42b-f5b7-493e-ae47-ebd772e1008f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:45:55.498828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51c42b-f5b7-493e-ae47-ebd772e1008f service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:45:55.517641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 722/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:45:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:46:04.937155 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=22 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:05.515342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=66 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:15.469218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5179cb3-8eef-4d74-b933-d25ed73966ac None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:15.469767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5179cb3-8eef-4d74-b933-d25ed73966ac None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:15.469891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5179cb3-8eef-4d74-b933-d25ed73966ac None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:15.471132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 749/1471] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:15.476280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abf674-3d78-43f7-91f4-680db52f6206 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:15.476731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abf674-3d78-43f7-91f4-680db52f6206 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:15.476834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1abf674-3d78-43f7-91f4-680db52f6206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:15.542109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-d1abf674-3d78-43f7-91f4-680db52f6206 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:15.543328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d1abf674-3d78-43f7-91f4-680db52f6206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:15.640406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 723/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:46:15.941613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa236fc7-c188-4665-8f50-274de6b45bf4 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:15.941899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa236fc7-c188-4665-8f50-274de6b45bf4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:15.942175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa236fc7-c188-4665-8f50-274de6b45bf4 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:15.943543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 750/1473] 10.222.0.25 () {54 vars in 962 bytes} [Tue Oct 4 08:46:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:15.948797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a7d43-59fb-4088-af30-7caed835a916 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:15.949088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a7d43-59fb-4088-af30-7caed835a916 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:15.949360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a7d43-59fb-4088-af30-7caed835a916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:16.022653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-848a7d43-59fb-4088-af30-7caed835a916 None None] MFA Rules not processed for user `4289134c7df04f96a5c4661165105109`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:16.023874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-848a7d43-59fb-4088-af30-7caed835a916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:16.043683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:16.098375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 724/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Tue Oct 4 08:46:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:46:16.106309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa236fc7-c188-4665-8f50-274de6b45bf4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:16.108394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fa236fc7-c188-4665-8f50-274de6b45bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:16.209370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa236fc7-c188-4665-8f50-274de6b45bf4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:16.280723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338915be-b904-4c30-9673-3d5a29102781 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:16.281328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338915be-b904-4c30-9673-3d5a29102781 service glance] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:16.281605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338915be-b904-4c30-9673-3d5a29102781 service glance] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:16.281876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338915be-b904-4c30-9673-3d5a29102781 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:16.283465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-338915be-b904-4c30-9673-3d5a29102781 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:16.338284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:16.392004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338915be-b904-4c30-9673-3d5a29102781 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:16.393471 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338915be-b904-4c30-9673-3d5a29102781 service glance] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:16.412178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 751/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:46:18.660044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d627e-139f-47e6-a3ed-4716c7858bd3 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:18.660579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d627e-139f-47e6-a3ed-4716c7858bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:18.660579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350d627e-139f-47e6-a3ed-4716c7858bd3 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:18.661977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 725/1476] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:46:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:18.667402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0ed6b-5f10-4526-bd40-d1a4354949a7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:18.667841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0ed6b-5f10-4526-bd40-d1a4354949a7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:18.667994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0ed6b-5f10-4526-bd40-d1a4354949a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:18.734475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-47d0ed6b-5f10-4526-bd40-d1a4354949a7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:18.735722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-47d0ed6b-5f10-4526-bd40-d1a4354949a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:18.829378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 752/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:46:19.101466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d627e-139f-47e6-a3ed-4716c7858bd3 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:19.105951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-350d627e-139f-47e6-a3ed-4716c7858bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:19.227005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350d627e-139f-47e6-a3ed-4716c7858bd3 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:19.276595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:19.320512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10a8e8a-2b43-403f-ab62-0209465e4c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:19.321113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a8e8a-2b43-403f-ab62-0209465e4c70 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:19.321391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a8e8a-2b43-403f-ab62-0209465e4c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:19.321662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a8e8a-2b43-403f-ab62-0209465e4c70 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:19.322295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a8e8a-2b43-403f-ab62-0209465e4c70 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:19.324030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING py.warnings [None req-b10a8e8a-2b43-403f-ab62-0209465e4c70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:46:19.324030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: warnings.warn(msg) Oct 04 08:46:19.324030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: Oct 04 08:46:19.325171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10a8e8a-2b43-403f-ab62-0209465e4c70 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:19.344839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 726/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Tue Oct 4 08:46:19 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:46:21.486069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346fdbd-3bf3-4f4c-ba3b-fb8a4731439e None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:21.486641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346fdbd-3bf3-4f4c-ba3b-fb8a4731439e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:21.486641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2346fdbd-3bf3-4f4c-ba3b-fb8a4731439e None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:21.488053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 753/1479] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:46:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:21.493664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109987d-652c-478c-8451-f625aec51e17 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:21.494060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109987d-652c-478c-8451-f625aec51e17 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:21.494219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d109987d-652c-478c-8451-f625aec51e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:21.559150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-d109987d-652c-478c-8451-f625aec51e17 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:21.560373 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d109987d-652c-478c-8451-f625aec51e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:21.655044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 727/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:46:21.948100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346fdbd-3bf3-4f4c-ba3b-fb8a4731439e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:21.949586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2346fdbd-3bf3-4f4c-ba3b-fb8a4731439e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:21.959065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:22.090798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2346fdbd-3bf3-4f4c-ba3b-fb8a4731439e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:22.170004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:22.201401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f55c12-946a-48c8-9dc5-2b7fbb7c2ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:22.202003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55c12-946a-48c8-9dc5-2b7fbb7c2ad0 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:22.202284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55c12-946a-48c8-9dc5-2b7fbb7c2ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:22.202568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f55c12-946a-48c8-9dc5-2b7fbb7c2ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:22.204252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d1f55c12-946a-48c8-9dc5-2b7fbb7c2ad0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:22.292359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f55c12-946a-48c8-9dc5-2b7fbb7c2ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:22.293951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f55c12-946a-48c8-9dc5-2b7fbb7c2ad0 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:22.312213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 754/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:46:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:46:24.628464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d83342-2aa3-41ee-bd56-37c4c289dda6 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:24.628952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d83342-2aa3-41ee-bd56-37c4c289dda6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:24.629056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d83342-2aa3-41ee-bd56-37c4c289dda6 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:24.630358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 728/1482] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:46:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:24.635540 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07fbe0-c692-44f4-86ad-ed445b9574e6 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:24.636010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07fbe0-c692-44f4-86ad-ed445b9574e6 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:24.636139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07fbe0-c692-44f4-86ad-ed445b9574e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:24.701264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8a07fbe0-c692-44f4-86ad-ed445b9574e6 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:24.702453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8a07fbe0-c692-44f4-86ad-ed445b9574e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:24.746243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:24.795952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 755/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:46:25.083037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d83342-2aa3-41ee-bd56-37c4c289dda6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:25.084601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-18d83342-2aa3-41ee-bd56-37c4c289dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:25.108206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:25.186545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d83342-2aa3-41ee-bd56-37c4c289dda6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:25.257678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b1932-fbb7-424b-b2e9-3359b2f16dee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:25.258282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b1932-fbb7-424b-b2e9-3359b2f16dee service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:25.258563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b1932-fbb7-424b-b2e9-3359b2f16dee service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:25.258835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b1932-fbb7-424b-b2e9-3359b2f16dee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:25.260437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2c7b1932-fbb7-424b-b2e9-3359b2f16dee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:25.335627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:25.370526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b1932-fbb7-424b-b2e9-3359b2f16dee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:25.372000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b1932-fbb7-424b-b2e9-3359b2f16dee service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:25.389731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 729/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:46:27.587625 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83b423-9401-4273-bde3-0483ded88b5f None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:27.588200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83b423-9401-4273-bde3-0483ded88b5f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:27.588200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83b423-9401-4273-bde3-0483ded88b5f None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:27.589716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 756/1485] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:27.595342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65bc5d-bf70-473f-9e64-e919797670c2 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:27.595750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65bc5d-bf70-473f-9e64-e919797670c2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:27.595950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af65bc5d-bf70-473f-9e64-e919797670c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:27.660096 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-af65bc5d-bf70-473f-9e64-e919797670c2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:27.661320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-af65bc5d-bf70-473f-9e64-e919797670c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:27.754754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 730/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:46:28.043621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83b423-9401-4273-bde3-0483ded88b5f None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:28.045157 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7a83b423-9401-4273-bde3-0483ded88b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:28.147824 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83b423-9401-4273-bde3-0483ded88b5f None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:28.226989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:28.228484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57672b12-9719-43ea-8ff2-de2293fcc7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:28.229079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57672b12-9719-43ea-8ff2-de2293fcc7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:28.229357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57672b12-9719-43ea-8ff2-de2293fcc7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:28.229628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57672b12-9719-43ea-8ff2-de2293fcc7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:28.231190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-57672b12-9719-43ea-8ff2-de2293fcc7b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:28.337425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57672b12-9719-43ea-8ff2-de2293fcc7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:28.338779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57672b12-9719-43ea-8ff2-de2293fcc7b6 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:28.356361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 757/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:46:30.644060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e2d07-815d-40fb-95b0-8c86d69c2dfc None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:30.644616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e2d07-815d-40fb-95b0-8c86d69c2dfc None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:30.644616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597e2d07-815d-40fb-95b0-8c86d69c2dfc None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:30.645944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 731/1488] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:46:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:30.651128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdcba1-09e8-46ae-b1aa-dc1e670ddf69 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:30.651596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdcba1-09e8-46ae-b1aa-dc1e670ddf69 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:30.651782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cdcba1-09e8-46ae-b1aa-dc1e670ddf69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:30.718170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-79cdcba1-09e8-46ae-b1aa-dc1e670ddf69 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:30.719362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-79cdcba1-09e8-46ae-b1aa-dc1e670ddf69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:30.770086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:30.812756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 758/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:46:31.103540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e2d07-815d-40fb-95b0-8c86d69c2dfc None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:31.105059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-597e2d07-815d-40fb-95b0-8c86d69c2dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:31.140912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:31.207237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597e2d07-815d-40fb-95b0-8c86d69c2dfc None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:31.279901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56c427b-c51d-483d-a50e-529d6e41d45b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:31.280504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c427b-c51d-483d-a50e-529d6e41d45b service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:31.280780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c427b-c51d-483d-a50e-529d6e41d45b service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:31.281049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56c427b-c51d-483d-a50e-529d6e41d45b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:31.282623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e56c427b-c51d-483d-a50e-529d6e41d45b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:31.364353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:31.396218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c427b-c51d-483d-a50e-529d6e41d45b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:31.397644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56c427b-c51d-483d-a50e-529d6e41d45b service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:31.415724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 732/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:46:34.070508 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870a319-6e94-4701-bdaf-3531e6d5fe4a None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:34.071097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870a319-6e94-4701-bdaf-3531e6d5fe4a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:34.071097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870a319-6e94-4701-bdaf-3531e6d5fe4a None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:34.072405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 759/1491] 10.222.0.25 () {54 vars in 927 bytes} [Tue Oct 4 08:46:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:46:34.077652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aea13-918f-4b9d-afaa-f1c699584b25 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:34.078116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aea13-918f-4b9d-afaa-f1c699584b25 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:34.078234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5aea13-918f-4b9d-afaa-f1c699584b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:34.143864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ae5aea13-918f-4b9d-afaa-f1c699584b25 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:46:34.145059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ae5aea13-918f-4b9d-afaa-f1c699584b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:34.241464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 733/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Tue Oct 4 08:46:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:46:34.533080 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870a319-6e94-4701-bdaf-3531e6d5fe4a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:46:34.534599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8870a319-6e94-4701-bdaf-3531e6d5fe4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:34.636593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870a319-6e94-4701-bdaf-3531e6d5fe4a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:46:34.709412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912defb4-0338-4b37-b13f-917935f71edc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:46:34.710006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912defb4-0338-4b37-b13f-917935f71edc service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:46:34.710283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912defb4-0338-4b37-b13f-917935f71edc service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:46:34.710551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912defb4-0338-4b37-b13f-917935f71edc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:46:34.712137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-912defb4-0338-4b37-b13f-917935f71edc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:46:34.721173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:34.819173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912defb4-0338-4b37-b13f-917935f71edc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:46:34.820846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912defb4-0338-4b37-b13f-917935f71edc service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:46:34.839039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 760/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:46:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:46:44.239962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=82 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:46:44.836850 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=50 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:58.690653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5efcb-aac7-4ea5-a53a-602ccf1b99b6 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.691181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5efcb-aac7-4ea5-a53a-602ccf1b99b6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.691181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e5efcb-aac7-4ea5-a53a-602ccf1b99b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.765973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-48e5efcb-aac7-4ea5-a53a-602ccf1b99b6 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:58.767167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-48e5efcb-aac7-4ea5-a53a-602ccf1b99b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:58.862193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 734/1494] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:58.870117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f253ce-a080-4775-b1c4-5d795aabc8a9 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:58.870617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f253ce-a080-4775-b1c4-5d795aabc8a9 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:58.870736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f253ce-a080-4775-b1c4-5d795aabc8a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:58.944920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c3f253ce-a080-4775-b1c4-5d795aabc8a9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:47:58.946140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c3f253ce-a080-4775-b1c4-5d795aabc8a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.039433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 761/1495] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:47:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:47:59.044097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5efcb-aac7-4ea5-a53a-602ccf1b99b6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.045292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-48e5efcb-aac7-4ea5-a53a-602ccf1b99b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.056973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e5efcb-aac7-4ea5-a53a-602ccf1b99b6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.119498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:59.151677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.152282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.153063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.153338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.153982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:47:59.154337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.155335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING py.warnings [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:59.155335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: warnings.warn(msg) Oct 04 08:47:59.155335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: Oct 04 08:47:59.156258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.168727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 735/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:47:59.176929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f253ce-a080-4775-b1c4-5d795aabc8a9 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.185818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f253ce-a080-4775-b1c4-5d795aabc8a9 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.245486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:59.277191 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.278389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.278660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.278924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.279627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.281341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: WARNING py.warnings [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:59.281341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: warnings.warn(msg) Oct 04 08:47:59.281341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: Oct 04 08:47:59.282517 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.452869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 762/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:47:59 2022] POST /identity/v3/projects => generated 379 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:59.457159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.458753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.491581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb399b21-c281-45a6-b044-34196322dae8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.583587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.584195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.584472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.584739 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.585373 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.586368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING py.warnings [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:59.586368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: warnings.warn(msg) Oct 04 08:47:59.586368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: Oct 04 08:47:59.587607 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.700266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 736/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:47:59 2022] POST /identity/v3/users => generated 290 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:47:59.704254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.705743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.766706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90255139-a0fe-4273-89ec-4fe4d5d6d3de admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.848407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:59.858195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.862555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.862555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.862555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.862555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.862555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: WARNING py.warnings [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:59.862555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: warnings.warn(msg) Oct 04 08:47:59.862555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: Oct 04 08:47:59.863256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:47:59.874993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 763/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:47:59.879173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:47:59.880709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:47:59.892449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e208c4-07ab-462a-bdfc-badaff985cb6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:47:59.916861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:47:59.985759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd08bae-3b79-4375-bf80-07cfd5ddb1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:47:59.986300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd08bae-3b79-4375-bf80-07cfd5ddb1ef admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:47:59.986578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd08bae-3b79-4375-bf80-07cfd5ddb1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:47:59.986849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd08bae-3b79-4375-bf80-07cfd5ddb1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:47:59.987487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd08bae-3b79-4375-bf80-07cfd5ddb1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:47:59.988606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING py.warnings [None req-bbd08bae-3b79-4375-bf80-07cfd5ddb1ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:47:59.988606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: warnings.warn(msg) Oct 04 08:47:59.988606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: Oct 04 08:47:59.989516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd08bae-3b79-4375-bf80-07cfd5ddb1ef admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:00.004688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 737/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:47:59 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:48:00.008896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:00.010381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.042605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766dfac-6c36-4042-902c-f8c5ce302a68 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:00.135025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244db20b-a1bf-42f8-9afb-3d54d523f5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:00.135700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244db20b-a1bf-42f8-9afb-3d54d523f5ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.135980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244db20b-a1bf-42f8-9afb-3d54d523f5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.136252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244db20b-a1bf-42f8-9afb-3d54d523f5ec admin admin] PATH_INFO: `/v3/projects/ab3c6f2fcf664c7f81470f3c2d719ff1/users/5f0a9bc1746d41379ddf1156d609dcb2/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.159642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244db20b-a1bf-42f8-9afb-3d54d523f5ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3c6f2fcf664c7f81470f3c2d719ff1, user_id=5f0a9bc1746d41379ddf1156d609dcb2, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:00.160680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: WARNING py.warnings [None req-244db20b-a1bf-42f8-9afb-3d54d523f5ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:48:00.160680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: warnings.warn(msg) Oct 04 08:48:00.160680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: Oct 04 08:48:00.162644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244db20b-a1bf-42f8-9afb-3d54d523f5ec admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:00.239911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 764/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:48:00 2022] PUT /identity/v3/projects/ab3c6f2fcf664c7f81470f3c2d719ff1/users/5f0a9bc1746d41379ddf1156d609dcb2/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:00.252090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0bcc9-eca1-41c4-a1f2-0af122b7763a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.252374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0bcc9-eca1-41c4-a1f2-0af122b7763a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.252647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0bcc9-eca1-41c4-a1f2-0af122b7763a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.308450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bce0bcc9-eca1-41c4-a1f2-0af122b7763a None None] MFA Rules not processed for user `5f0a9bc1746d41379ddf1156d609dcb2`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:00.309660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bce0bcc9-eca1-41c4-a1f2-0af122b7763a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.386570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 738/1502] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:00.400256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcd265-0bd8-4fc2-8578-8402326d7a09 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.400575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcd265-0bd8-4fc2-8578-8402326d7a09 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.400855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcd265-0bd8-4fc2-8578-8402326d7a09 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.402358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 765/1503] 10.222.0.25 () {54 vars in 963 bytes} [Tue Oct 4 08:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:48:00.407499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfaef9-1e2f-46db-9b8c-5ba1a0cba614 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.407807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfaef9-1e2f-46db-9b8c-5ba1a0cba614 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.408078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfaef9-1e2f-46db-9b8c-5ba1a0cba614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.438918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:00.482150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9ddfaef9-1e2f-46db-9b8c-5ba1a0cba614 None None] MFA Rules not processed for user `6f4df3626bdb4e3a88ce27eaabf4ca1f`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:00.483351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9ddfaef9-1e2f-46db-9b8c-5ba1a0cba614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.556269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 739/1504] 10.222.0.25 () {58 vars in 1060 bytes} [Tue Oct 4 08:48:00 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:00.564524 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcd265-0bd8-4fc2-8578-8402326d7a09 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:00.566070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7dfcd265-0bd8-4fc2-8578-8402326d7a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.614842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:00.666997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcd265-0bd8-4fc2-8578-8402326d7a09 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:00.738339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:00.738937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.739216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.739487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.741070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:00.836251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:00.837604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:00.841031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:00.854628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 766/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:00.900350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526e66b-664d-45d3-b585-cbde248297e0 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:00.900765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526e66b-664d-45d3-b585-cbde248297e0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:00.900903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526e66b-664d-45d3-b585-cbde248297e0 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:00.902160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 740/1506] 10.222.0.25 () {52 vars in 830 bytes} [Tue Oct 4 08:48:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:48:00.905805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:00.906993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:01.003476 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a895ac-f3a4-45dd-b309-174ab86b0d7c service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.092835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.093386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.093703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.093973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] PATH_INFO: `/v3/users/5f0a9bc1746d41379ddf1156d609dcb2` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.107487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f0a9bc1746d41379ddf1156d609dcb2)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.108568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: WARNING py.warnings [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:48:01.108568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: warnings.warn(msg) Oct 04 08:48:01.108568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: Oct 04 08:48:01.109766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.119476 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:01.387444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f0a9bc1746d41379ddf1156d609dcb2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.400986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f0a9bc1746d41379ddf1156d609dcb2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.401430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f0a9bc1746d41379ddf1156d609dcb2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.401952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f0a9bc1746d41379ddf1156d609dcb2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.469687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f0a9bc1746d41379ddf1156d609dcb2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:01.499430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 767/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:48:00 2022] DELETE /identity/v3/users/5f0a9bc1746d41379ddf1156d609dcb2 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:01.503901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988dc8b-d7b6-421b-ad28-c07084cd91be None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.504184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988dc8b-d7b6-421b-ad28-c07084cd91be None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.504454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e988dc8b-d7b6-421b-ad28-c07084cd91be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.561411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-e988dc8b-d7b6-421b-ad28-c07084cd91be None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:48:01.562619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e988dc8b-d7b6-421b-ad28-c07084cd91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:01.639677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:01.652271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 741/1508] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:48:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:48:01.662383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:01.663680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:01.759258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c720b5d1-15d8-441b-a2a7-76bce55b8974 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:01.812348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:01.831276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e777d683-0bf4-41b7-acd1-0cd2b42fe235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:01.831937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d683-0bf4-41b7-acd1-0cd2b42fe235 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:01.832205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d683-0bf4-41b7-acd1-0cd2b42fe235 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:01.832477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777d683-0bf4-41b7-acd1-0cd2b42fe235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:01.834082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e777d683-0bf4-41b7-acd1-0cd2b42fe235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:01.945335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777d683-0bf4-41b7-acd1-0cd2b42fe235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:01.946779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e777d683-0bf4-41b7-acd1-0cd2b42fe235 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:01.965594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 768/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:48:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:48:02.454931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988dc8b-d7b6-421b-ad28-c07084cd91be None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:48:02.456226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e988dc8b-d7b6-421b-ad28-c07084cd91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:48:02.468900 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e988dc8b-d7b6-421b-ad28-c07084cd91be None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:48:02.563407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:48:02.564059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:48:02.564335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:48:02.564607 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] PATH_INFO: `/v3/projects/ab3c6f2fcf664c7f81470f3c2d719ff1` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:48:02.574860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3c6f2fcf664c7f81470f3c2d719ff1)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:48:02.575956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING py.warnings [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:48:02.575956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: warnings.warn(msg) Oct 04 08:48:02.575956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: Oct 04 08:48:02.577171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:48:02.704760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3c6f2fcf664c7f81470f3c2d719ff1', 'request_id': 'req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.789253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3c6f2fcf664c7f81470f3c2d719ff1', 'request_id': 'req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.803378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3c6f2fcf664c7f81470f3c2d719ff1', 'request_id': 'req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.826003 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] The token cache is being invalidate because project ab3c6f2fcf664c7f81470f3c2d719ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:48:02.826289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.826711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac14bbe8-7361-42b9-9bbd-1a767074a0bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:48:02.828130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 742/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:48:02 2022] DELETE /identity/v3/projects/ab3c6f2fcf664c7f81470f3c2d719ff1 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:48:11.963335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=62 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:48:12.824290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:38.473221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0b883-90ee-4f8f-b510-b5dd7951044b None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:38.473786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0b883-90ee-4f8f-b510-b5dd7951044b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:38.473786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d0b883-90ee-4f8f-b510-b5dd7951044b None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:38.475054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:49:38.479917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5374c-7dff-4c5c-956a-34f1a400cae0 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:38.480343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5374c-7dff-4c5c-956a-34f1a400cae0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:38.480574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5374c-7dff-4c5c-956a-34f1a400cae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:38.558624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8ab5374c-7dff-4c5c-956a-34f1a400cae0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:38.559867 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8ab5374c-7dff-4c5c-956a-34f1a400cae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:38.662503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:38.814714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0b883-90ee-4f8f-b510-b5dd7951044b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:38.816842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-50d0b883-90ee-4f8f-b510-b5dd7951044b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:38.937477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d0b883-90ee-4f8f-b510-b5dd7951044b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:38.943388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4502d68-93b5-47c8-837e-6419cb091c19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:38.944029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502d68-93b5-47c8-837e-6419cb091c19 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:38.944309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502d68-93b5-47c8-837e-6419cb091c19 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:38.944585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4502d68-93b5-47c8-837e-6419cb091c19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:38.953289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4502d68-93b5-47c8-837e-6419cb091c19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:38.954871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4502d68-93b5-47c8-837e-6419cb091c19 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:38.964977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 770/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:40.041152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef556d-ab8c-49b1-aea4-549b47cd54d4 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:40.041699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef556d-ab8c-49b1-aea4-549b47cd54d4 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:40.041699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef556d-ab8c-49b1-aea4-549b47cd54d4 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:40.043051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:49:40.049722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a27cb-15be-4d9c-974d-cb3b51554c07 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:40.050177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a27cb-15be-4d9c-974d-cb3b51554c07 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:40.050279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a27cb-15be-4d9c-974d-cb3b51554c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:40.069481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-0d3a27cb-15be-4d9c-974d-cb3b51554c07 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:40.071788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0d3a27cb-15be-4d9c-974d-cb3b51554c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:40.080742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:49:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:40.193434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894442-f794-4a0b-92c1-f451177c396a None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:40.193733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894442-f794-4a0b-92c1-f451177c396a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:40.194011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a894442-f794-4a0b-92c1-f451177c396a None None] PATH_INFO: `/v3` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:40.195431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 745/1516] 10.222.0.36 () {54 vars in 925 bytes} [Tue Oct 4 08:49:40 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:49:40.202325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d75df-0102-4531-bdf7-57017e882169 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:40.202611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d75df-0102-4531-bdf7-57017e882169 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:40.203704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d75df-0102-4531-bdf7-57017e882169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:40.234854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894442-f794-4a0b-92c1-f451177c396a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:40.248857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a894442-f794-4a0b-92c1-f451177c396a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:40.254202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec92c72-0256-4bf4-a1cc-970c33ae81f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:40.255425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec92c72-0256-4bf4-a1cc-970c33ae81f7 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:40.255737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec92c72-0256-4bf4-a1cc-970c33ae81f7 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:40.256010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec92c72-0256-4bf4-a1cc-970c33ae81f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:40.262845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-1b8d75df-0102-4531-bdf7-57017e882169 None None] MFA Rules not processed for user `22aa2b6e4b854de4868b75cc9626b8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:40.263963 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec92c72-0256-4bf4-a1cc-970c33ae81f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:40.264079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1b8d75df-0102-4531-bdf7-57017e882169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:40.265518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec92c72-0256-4bf4-a1cc-970c33ae81f7 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:40.275553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 746/1517] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:49:40.317700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:49:40.338097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 772/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Oct 4 08:49:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:44.476809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5e71-9a19-41f8-940f-2cc86b3c74d0 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:44.477269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5e71-9a19-41f8-940f-2cc86b3c74d0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:44.477375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5e71-9a19-41f8-940f-2cc86b3c74d0 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:44.478684 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 747/1519] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 08:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:49:44.484026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af965-0ee7-426a-9915-3d949a7819d7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:44.484429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af965-0ee7-426a-9915-3d949a7819d7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:44.484638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20af965-0ee7-426a-9915-3d949a7819d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:44.504167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b20af965-0ee7-426a-9915-3d949a7819d7 None None] MFA Rules not processed for user `22aa2b6e4b854de4868b75cc9626b8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:44.505345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b20af965-0ee7-426a-9915-3d949a7819d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:44.513668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 773/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 08:49:44 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:44.520980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5e71-9a19-41f8-940f-2cc86b3c74d0 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:44.534626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5e71-9a19-41f8-940f-2cc86b3c74d0 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:44.540356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcdd23e-c227-445a-adc7-6c9b14971617 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:44.540944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdd23e-c227-445a-adc7-6c9b14971617 service placement] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:44.541223 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdd23e-c227-445a-adc7-6c9b14971617 service placement] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:44.541498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcdd23e-c227-445a-adc7-6c9b14971617 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:44.549551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdd23e-c227-445a-adc7-6c9b14971617 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:44.551101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcdd23e-c227-445a-adc7-6c9b14971617 service placement] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:44.560507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 748/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:49:51.758112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23967f4-e4b0-4830-974c-66db7ede66d1 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:51.758673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23967f4-e4b0-4830-974c-66db7ede66d1 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:51.758673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23967f4-e4b0-4830-974c-66db7ede66d1 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:51.760034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:49:51.766079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265de84-a15c-49d4-bd6f-d96bd5d34705 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:51.766493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265de84-a15c-49d4-bd6f-d96bd5d34705 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:51.766669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265de84-a15c-49d4-bd6f-d96bd5d34705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:51.786149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7265de84-a15c-49d4-bd6f-d96bd5d34705 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:51.787344 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7265de84-a15c-49d4-bd6f-d96bd5d34705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:51.795612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:51.947446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23967f4-e4b0-4830-974c-66db7ede66d1 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:51.962237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23967f4-e4b0-4830-974c-66db7ede66d1 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:51.967812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7ddf1-b229-4637-8393-1254abae83f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:51.968247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7ddf1-b229-4637-8393-1254abae83f3 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:51.968533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7ddf1-b229-4637-8393-1254abae83f3 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:51.968806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7ddf1-b229-4637-8393-1254abae83f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:51.977255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7ddf1-b229-4637-8393-1254abae83f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:51.978824 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7ddf1-b229-4637-8393-1254abae83f3 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:51.988056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 775/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:53.058873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf46a2-412b-4706-9b90-bda9c3a1a274 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:53.059441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf46a2-412b-4706-9b90-bda9c3a1a274 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:53.059441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baf46a2-412b-4706-9b90-bda9c3a1a274 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:53.060793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Oct 4 08:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:49:53.066972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa787760-417f-4b4d-b870-db507fef5d66 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:53.067405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa787760-417f-4b4d-b870-db507fef5d66 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:53.067549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa787760-417f-4b4d-b870-db507fef5d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:53.087744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-aa787760-417f-4b4d-b870-db507fef5d66 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:53.088959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-aa787760-417f-4b4d-b870-db507fef5d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:53.096708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Oct 4 08:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:53.249382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf46a2-412b-4706-9b90-bda9c3a1a274 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:53.263478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baf46a2-412b-4706-9b90-bda9c3a1a274 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:53.268901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10b28d-9bbf-4cb5-9697-77d616c44c70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:53.269490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10b28d-9bbf-4cb5-9697-77d616c44c70 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:53.269769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10b28d-9bbf-4cb5-9697-77d616c44c70 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:53.270044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10b28d-9bbf-4cb5-9697-77d616c44c70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:53.277984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10b28d-9bbf-4cb5-9697-77d616c44c70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:53.279568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10b28d-9bbf-4cb5-9697-77d616c44c70 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:53.289215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 751/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:49:57.486486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163e1c-f40e-41ea-9533-78f002c817df None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:57.487063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163e1c-f40e-41ea-9533-78f002c817df None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:57.487063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76163e1c-f40e-41ea-9533-78f002c817df None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:57.488417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:49:57.493768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c017769-a11e-4d8e-99a3-23256fd0aa91 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:57.494174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c017769-a11e-4d8e-99a3-23256fd0aa91 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:57.494411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c017769-a11e-4d8e-99a3-23256fd0aa91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:57.515137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8c017769-a11e-4d8e-99a3-23256fd0aa91 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:49:57.516526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8c017769-a11e-4d8e-99a3-23256fd0aa91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:57.525778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:49:57.820915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76163e1c-f40e-41ea-9533-78f002c817df None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:49:57.822612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-76163e1c-f40e-41ea-9533-78f002c817df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:49:57.898964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76163e1c-f40e-41ea-9533-78f002c817df None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:49:57.902481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a617b3c-6d3f-4dc7-966b-1f205500b342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:49:57.903084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a617b3c-6d3f-4dc7-966b-1f205500b342 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:49:57.903364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a617b3c-6d3f-4dc7-966b-1f205500b342 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:49:57.903662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a617b3c-6d3f-4dc7-966b-1f205500b342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:49:57.912258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a617b3c-6d3f-4dc7-966b-1f205500b342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:49:57.914209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a617b3c-6d3f-4dc7-966b-1f205500b342 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:49:57.923272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 778/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:50:00.050823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866e76a-0078-466a-99c0-81e5c7ebaab3 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:00.051410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866e76a-0078-466a-99c0-81e5c7ebaab3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:00.051410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7866e76a-0078-466a-99c0-81e5c7ebaab3 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:00.052799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:50:00.058005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde92295-a730-4842-ba38-f76e9ebc038f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:00.058416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde92295-a730-4842-ba38-f76e9ebc038f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:00.058541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde92295-a730-4842-ba38-f76e9ebc038f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:00.078183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-dde92295-a730-4842-ba38-f76e9ebc038f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:00.079661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-dde92295-a730-4842-ba38-f76e9ebc038f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:00.088036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:50:00.376582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866e76a-0078-466a-99c0-81e5c7ebaab3 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:00.387950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7866e76a-0078-466a-99c0-81e5c7ebaab3 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:00.391363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260f91d-c662-453d-a309-f5b9250d9e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:00.391984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260f91d-c662-453d-a309-f5b9250d9e02 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:00.392261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260f91d-c662-453d-a309-f5b9250d9e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:00.392531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260f91d-c662-453d-a309-f5b9250d9e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:00.401118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260f91d-c662-453d-a309-f5b9250d9e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:00.402522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260f91d-c662-453d-a309-f5b9250d9e02 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:00.411571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 754/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:50:04.115256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf513263-ae05-4d52-8d8e-a30acf34b05c None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:04.115910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf513263-ae05-4d52-8d8e-a30acf34b05c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:04.115910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf513263-ae05-4d52-8d8e-a30acf34b05c None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:04.117731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:50:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:50:04.122796 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002604fa-ed21-4b98-9529-360a41e70c3f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:04.123234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002604fa-ed21-4b98-9529-360a41e70c3f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:04.123339 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002604fa-ed21-4b98-9529-360a41e70c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:04.130896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:04.144811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-002604fa-ed21-4b98-9529-360a41e70c3f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:04.146032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-002604fa-ed21-4b98-9529-360a41e70c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:04.153815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:50:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:50:04.457293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf513263-ae05-4d52-8d8e-a30acf34b05c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:04.458973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bf513263-ae05-4d52-8d8e-a30acf34b05c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:04.537736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf513263-ae05-4d52-8d8e-a30acf34b05c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:04.542420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25a014-3ce8-4d25-8f1c-59b399f0367e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:04.543018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25a014-3ce8-4d25-8f1c-59b399f0367e service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:04.543293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25a014-3ce8-4d25-8f1c-59b399f0367e service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:04.543595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25a014-3ce8-4d25-8f1c-59b399f0367e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:04.552908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25a014-3ce8-4d25-8f1c-59b399f0367e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:04.555081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25a014-3ce8-4d25-8f1c-59b399f0367e service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:04.564862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 781/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:50:06.711409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0fbe-9c02-4018-99f9-fe4bb4d8f89d None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:06.712060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0fbe-9c02-4018-99f9-fe4bb4d8f89d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:06.712060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80a0fbe-9c02-4018-99f9-fe4bb4d8f89d None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:06.713384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Oct 4 08:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:50:06.718678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03933f-7680-4ecc-af2b-8bfdd2833344 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:06.719138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03933f-7680-4ecc-af2b-8bfdd2833344 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:06.719286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03933f-7680-4ecc-af2b-8bfdd2833344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:06.738180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-3c03933f-7680-4ecc-af2b-8bfdd2833344 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:50:06.739372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3c03933f-7680-4ecc-af2b-8bfdd2833344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:06.747291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Oct 4 08:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:50:07.048031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a0fbe-9c02-4018-99f9-fe4bb4d8f89d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:50:07.049751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a80a0fbe-9c02-4018-99f9-fe4bb4d8f89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:50:07.062980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80a0fbe-9c02-4018-99f9-fe4bb4d8f89d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:50:07.066419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d01f816-a064-4d73-90f7-40129ee66f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:50:07.067003 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01f816-a064-4d73-90f7-40129ee66f94 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:50:07.067285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01f816-a064-4d73-90f7-40129ee66f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:50:07.067580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d01f816-a064-4d73-90f7-40129ee66f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:50:07.076807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01f816-a064-4d73-90f7-40129ee66f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:50:07.078203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d01f816-a064-4d73-90f7-40129ee66f94 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:50:07.088077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 757/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:50:16.733457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:50:17.083444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=8 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:38.109822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee002ab-1b80-44bb-a07b-b2dfdb10804c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.110470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee002ab-1b80-44bb-a07b-b2dfdb10804c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.110470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee002ab-1b80-44bb-a07b-b2dfdb10804c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.135389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-7ee002ab-1b80-44bb-a07b-b2dfdb10804c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.137221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7ee002ab-1b80-44bb-a07b-b2dfdb10804c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.152789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 783/1540] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.161694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71629469-6b7f-41dd-817b-b63eec15f4f1 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.162303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71629469-6b7f-41dd-817b-b63eec15f4f1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.162303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71629469-6b7f-41dd-817b-b63eec15f4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.182769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-71629469-6b7f-41dd-817b-b63eec15f4f1 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.188434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-71629469-6b7f-41dd-817b-b63eec15f4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.203417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 758/1541] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.208225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee002ab-1b80-44bb-a07b-b2dfdb10804c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:38.224381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee002ab-1b80-44bb-a07b-b2dfdb10804c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:38.231140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac548f-37b6-4064-af69-79ab9d25e8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:38.231821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac548f-37b6-4064-af69-79ab9d25e8cd admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.232103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac548f-37b6-4064-af69-79ab9d25e8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.232807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac548f-37b6-4064-af69-79ab9d25e8cd admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.233031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac548f-37b6-4064-af69-79ab9d25e8cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:51:38.233338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac548f-37b6-4064-af69-79ab9d25e8cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:38.234386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: WARNING py.warnings [None req-3cac548f-37b6-4064-af69-79ab9d25e8cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:51:38.234386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: warnings.warn(msg) Oct 04 08:51:38.234386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: Oct 04 08:51:38.235287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac548f-37b6-4064-af69-79ab9d25e8cd admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:38.251648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 784/1542] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:51:38.259565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71629469-6b7f-41dd-817b-b63eec15f4f1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:38.270247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71629469-6b7f-41dd-817b-b63eec15f4f1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:38.282842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9221b2fe-c7bf-4318-9e4c-f1e6cd400c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:38.283467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221b2fe-c7bf-4318-9e4c-f1e6cd400c2b admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.283773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221b2fe-c7bf-4318-9e4c-f1e6cd400c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.284051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9221b2fe-c7bf-4318-9e4c-f1e6cd400c2b admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.284725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221b2fe-c7bf-4318-9e4c-f1e6cd400c2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:38.285948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING py.warnings [None req-9221b2fe-c7bf-4318-9e4c-f1e6cd400c2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:51:38.285948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: warnings.warn(msg) Oct 04 08:51:38.285948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: Oct 04 08:51:38.287186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9221b2fe-c7bf-4318-9e4c-f1e6cd400c2b admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:38.356332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79575a-d1c3-455a-a771-ecc588704b54 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.356691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79575a-d1c3-455a-a771-ecc588704b54 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.356892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79575a-d1c3-455a-a771-ecc588704b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.387370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-fb79575a-d1c3-455a-a771-ecc588704b54 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.387370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fb79575a-d1c3-455a-a771-ecc588704b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.389852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 785/1543] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.398383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9e0c-3585-4417-ad21-8748df02e53e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.398730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9e0c-3585-4417-ad21-8748df02e53e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.398938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c9e0c-3585-4417-ad21-8748df02e53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.414320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 759/1544] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/projects => generated 389 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:38.416086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d989f7b-55d1-4543-816b-c94bccc21a4e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.416086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d989f7b-55d1-4543-816b-c94bccc21a4e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.416343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d989f7b-55d1-4543-816b-c94bccc21a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.446650 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-235c9e0c-3585-4417-ad21-8748df02e53e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.447921 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-235c9e0c-3585-4417-ad21-8748df02e53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.456865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-5d989f7b-55d1-4543-816b-c94bccc21a4e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.458104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5d989f7b-55d1-4543-816b-c94bccc21a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.536828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 786/1545] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:51:38.537743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c9e0c-3585-4417-ad21-8748df02e53e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:38.552486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c9e0c-3585-4417-ad21-8748df02e53e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:38.562366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e411ad-9c56-461f-9145-d116e61521d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:38.563297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e411ad-9c56-461f-9145-d116e61521d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.563818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e411ad-9c56-461f-9145-d116e61521d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.564629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e411ad-9c56-461f-9145-d116e61521d8 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.565462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e411ad-9c56-461f-9145-d116e61521d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:38.566682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: WARNING py.warnings [None req-27e411ad-9c56-461f-9145-d116e61521d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:51:38.566682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: warnings.warn(msg) Oct 04 08:51:38.566682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: Oct 04 08:51:38.575679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 760/1546] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.577231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e411ad-9c56-461f-9145-d116e61521d8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:38.577360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cf1c4-adfc-4e01-a98c-ff5938e32103 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.577825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cf1c4-adfc-4e01-a98c-ff5938e32103 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.578269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361cf1c4-adfc-4e01-a98c-ff5938e32103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.606541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-361cf1c4-adfc-4e01-a98c-ff5938e32103 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.611640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-361cf1c4-adfc-4e01-a98c-ff5938e32103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.620659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 761/1547] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.634231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cf1c4-adfc-4e01-a98c-ff5938e32103 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:38.639965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361cf1c4-adfc-4e01-a98c-ff5938e32103 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:38.645749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed365f-2cad-41eb-a20e-5b76b2c6ae43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:38.646647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed365f-2cad-41eb-a20e-5b76b2c6ae43 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.647098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed365f-2cad-41eb-a20e-5b76b2c6ae43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.647562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed365f-2cad-41eb-a20e-5b76b2c6ae43 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.648440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed365f-2cad-41eb-a20e-5b76b2c6ae43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:51:38.648924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed365f-2cad-41eb-a20e-5b76b2c6ae43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:38.651073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed365f-2cad-41eb-a20e-5b76b2c6ae43 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:38.666690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 762/1548] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:51:38.668776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118002a-5dde-40ec-9453-50f5e8a208b5 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.674330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118002a-5dde-40ec-9453-50f5e8a208b5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.674330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118002a-5dde-40ec-9453-50f5e8a208b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.691322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b118002a-5dde-40ec-9453-50f5e8a208b5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.692593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b118002a-5dde-40ec-9453-50f5e8a208b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.702021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 763/1549] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.703420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42179-f000-47e3-9e3c-bf1cf10626a9 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.703730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42179-f000-47e3-9e3c-bf1cf10626a9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.704013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b42179-f000-47e3-9e3c-bf1cf10626a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.725329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-98b42179-f000-47e3-9e3c-bf1cf10626a9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.726367 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-98b42179-f000-47e3-9e3c-bf1cf10626a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.733107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 787/1550] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/users => generated 295 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:38.739247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 764/1551] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.739383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f5bac-04a1-4d79-a5d6-8531e3e90dc5 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.739383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f5bac-04a1-4d79-a5d6-8531e3e90dc5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.739383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9f5bac-04a1-4d79-a5d6-8531e3e90dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.739652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fce5b-aa01-4fea-b78e-71af8f7048af None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.739652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fce5b-aa01-4fea-b78e-71af8f7048af None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.739652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09fce5b-aa01-4fea-b78e-71af8f7048af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.758025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b09fce5b-aa01-4fea-b78e-71af8f7048af None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.759261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b09fce5b-aa01-4fea-b78e-71af8f7048af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.763309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-6a9f5bac-04a1-4d79-a5d6-8531e3e90dc5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.764523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6a9f5bac-04a1-4d79-a5d6-8531e3e90dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.767797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 765/1552] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.768540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fce5b-aa01-4fea-b78e-71af8f7048af None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:38.772727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 788/1553] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.773909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840d6e-bfd4-4e26-8c25-8071ab30c74d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.774191 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840d6e-bfd4-4e26-8c25-8071ab30c74d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.774461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50840d6e-bfd4-4e26-8c25-8071ab30c74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.781512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09fce5b-aa01-4fea-b78e-71af8f7048af None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:38.786347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e3694-2276-4acd-bb61-d91d177f99aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:38.786945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e3694-2276-4acd-bb61-d91d177f99aa admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.787225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e3694-2276-4acd-bb61-d91d177f99aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.787494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e3694-2276-4acd-bb61-d91d177f99aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.788161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e3694-2276-4acd-bb61-d91d177f99aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:38.790059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e3694-2276-4acd-bb61-d91d177f99aa admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:38.793816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-50840d6e-bfd4-4e26-8c25-8071ab30c74d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.794989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-50840d6e-bfd4-4e26-8c25-8071ab30c74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.802735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 789/1554] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.804039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790622c-dac0-4537-9fcf-303fe2fc71b0 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.804320 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790622c-dac0-4537-9fcf-303fe2fc71b0 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.804592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8790622c-dac0-4537-9fcf-303fe2fc71b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.824788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8790622c-dac0-4537-9fcf-303fe2fc71b0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.828988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8790622c-dac0-4537-9fcf-303fe2fc71b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.833874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 790/1555] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.836391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790622c-dac0-4537-9fcf-303fe2fc71b0 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:38.847065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8790622c-dac0-4537-9fcf-303fe2fc71b0 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:38.851710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ec91-90df-49f3-96af-68fa547e3f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:38.852295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ec91-90df-49f3-96af-68fa547e3f19 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.852578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ec91-90df-49f3-96af-68fa547e3f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.852889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7500ec91-90df-49f3-96af-68fa547e3f19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.853492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500ec91-90df-49f3-96af-68fa547e3f19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:38.855124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7500ec91-90df-49f3-96af-68fa547e3f19 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:38.864822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 791/1556] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:38.865587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ec91-90df-49f3-96af-68fa547e3f19 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:38.874673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7500ec91-90df-49f3-96af-68fa547e3f19 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:38.879281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51958894-91cf-47e6-83cd-1b5ac927737f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:38.879883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51958894-91cf-47e6-83cd-1b5ac927737f admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.880166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51958894-91cf-47e6-83cd-1b5ac927737f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.880441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51958894-91cf-47e6-83cd-1b5ac927737f admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.881070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51958894-91cf-47e6-83cd-1b5ac927737f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:51:38.881368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51958894-91cf-47e6-83cd-1b5ac927737f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:38.882911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51958894-91cf-47e6-83cd-1b5ac927737f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:38.895325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 792/1557] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:51:38.899693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25dcd-425b-48cb-90d6-86557f421035 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.899846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 766/1558] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/projects => generated 391 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:38.899945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25dcd-425b-48cb-90d6-86557f421035 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.899945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd25dcd-425b-48cb-90d6-86557f421035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.900116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f6aea-c5d6-4211-89b5-fce7c9251cc4 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:38.900116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f6aea-c5d6-4211-89b5-fce7c9251cc4 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:38.900116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f6aea-c5d6-4211-89b5-fce7c9251cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:38.918881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-1dd25dcd-425b-48cb-90d6-86557f421035 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.919380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-118f6aea-c5d6-4211-89b5-fce7c9251cc4 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:38.920123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1dd25dcd-425b-48cb-90d6-86557f421035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.926683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-118f6aea-c5d6-4211-89b5-fce7c9251cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:38.979336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 793/1559] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.983045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 767/1560] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:38.983196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25dcd-425b-48cb-90d6-86557f421035 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:38.983316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f6aea-c5d6-4211-89b5-fce7c9251cc4 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:38.987922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:38.993073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd25dcd-425b-48cb-90d6-86557f421035 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:38.993234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f6aea-c5d6-4211-89b5-fce7c9251cc4 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:38.997759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c654fc-25f3-4eff-946b-37c24412dafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.002264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfd8bc-eb03-4a3c-99aa-dfe08b966851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.002386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c654fc-25f3-4eff-946b-37c24412dafc admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.002494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfd8bc-eb03-4a3c-99aa-dfe08b966851 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.002585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c654fc-25f3-4eff-946b-37c24412dafc admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.002694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfd8bc-eb03-4a3c-99aa-dfe08b966851 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.002790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c654fc-25f3-4eff-946b-37c24412dafc admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.002868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dfd8bc-eb03-4a3c-99aa-dfe08b966851 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.002940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c654fc-25f3-4eff-946b-37c24412dafc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:51:39.003020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfd8bc-eb03-4a3c-99aa-dfe08b966851 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:51:39.003182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c654fc-25f3-4eff-946b-37c24412dafc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.003272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfd8bc-eb03-4a3c-99aa-dfe08b966851 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.003346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c654fc-25f3-4eff-946b-37c24412dafc admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.003426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dfd8bc-eb03-4a3c-99aa-dfe08b966851 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.009950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:39.013543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 768/1561] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:51:39.020731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 794/1562] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:51:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:51:39.020894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fade7-13d4-42d3-b8ec-0769dfaef70b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.020894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fade7-13d4-42d3-b8ec-0769dfaef70b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.021052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfd8bc-eb03-4a3c-99aa-dfe08b966851 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.021127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fade7-13d4-42d3-b8ec-0769dfaef70b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.030767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dfd8bc-eb03-4a3c-99aa-dfe08b966851 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.035688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51416d-7353-4e13-b442-5a6261fd2ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.036288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51416d-7353-4e13-b442-5a6261fd2ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.042481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51416d-7353-4e13-b442-5a6261fd2ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.042613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-da8fade7-13d4-42d3-b8ec-0769dfaef70b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:39.042729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b51416d-7353-4e13-b442-5a6261fd2ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.042729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51416d-7353-4e13-b442-5a6261fd2ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.042926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-da8fade7-13d4-42d3-b8ec-0769dfaef70b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:39.043021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b51416d-7353-4e13-b442-5a6261fd2ce9 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.046675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 769/1563] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:39.047435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fade7-13d4-42d3-b8ec-0769dfaef70b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.049484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 795/1564] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:39.050252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51416d-7353-4e13-b442-5a6261fd2ce9 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.056632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fade7-13d4-42d3-b8ec-0769dfaef70b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.061198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aba193-1a58-454e-a64a-04f0f7dfb007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.061786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aba193-1a58-454e-a64a-04f0f7dfb007 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.062069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aba193-1a58-454e-a64a-04f0f7dfb007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.062342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aba193-1a58-454e-a64a-04f0f7dfb007 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.062694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b51416d-7353-4e13-b442-5a6261fd2ce9 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.062973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aba193-1a58-454e-a64a-04f0f7dfb007 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.064888 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aba193-1a58-454e-a64a-04f0f7dfb007 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.067390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15f1c2-b4cb-4997-97f6-ccd0c60c13a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.067976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15f1c2-b4cb-4997-97f6-ccd0c60c13a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.068603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15f1c2-b4cb-4997-97f6-ccd0c60c13a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.069218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15f1c2-b4cb-4997-97f6-ccd0c60c13a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.070394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15f1c2-b4cb-4997-97f6-ccd0c60c13a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.072506 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15f1c2-b4cb-4997-97f6-ccd0c60c13a1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.251293 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 770/1565] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/users => generated 296 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:39.252275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aba193-1a58-454e-a64a-04f0f7dfb007 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.262310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aba193-1a58-454e-a64a-04f0f7dfb007 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.266839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4045612-8e9a-43fa-af0a-f72b29df9be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.267418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4045612-8e9a-43fa-af0a-f72b29df9be2 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.267729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4045612-8e9a-43fa-af0a-f72b29df9be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.268005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4045612-8e9a-43fa-af0a-f72b29df9be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.268640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4045612-8e9a-43fa-af0a-f72b29df9be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:51:39.268942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4045612-8e9a-43fa-af0a-f72b29df9be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.270507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4045612-8e9a-43fa-af0a-f72b29df9be2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.282329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 771/1566] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:51:39.283470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00d125-4a62-43eb-9489-e0615d03f4cb None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.283779 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00d125-4a62-43eb-9489-e0615d03f4cb None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.284057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b00d125-4a62-43eb-9489-e0615d03f4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.287821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 796/1567] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/projects => generated 379 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:39.287821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15f1c2-b4cb-4997-97f6-ccd0c60c13a1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.304150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-4b00d125-4a62-43eb-9489-e0615d03f4cb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:39.305341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4b00d125-4a62-43eb-9489-e0615d03f4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:39.351220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15f1c2-b4cb-4997-97f6-ccd0c60c13a1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.355871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb5479-8a20-482d-a5a0-4de8da54d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.356474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb5479-8a20-482d-a5a0-4de8da54d66b admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.356753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb5479-8a20-482d-a5a0-4de8da54d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.357023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fb5479-8a20-482d-a5a0-4de8da54d66b admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.357677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb5479-8a20-482d-a5a0-4de8da54d66b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.359659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fb5479-8a20-482d-a5a0-4de8da54d66b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.364143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 772/1568] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:39.364957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00d125-4a62-43eb-9489-e0615d03f4cb None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.374512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b00d125-4a62-43eb-9489-e0615d03f4cb None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.379303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922626fc-c921-4980-93f8-f2b3d47ff46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.379710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922626fc-c921-4980-93f8-f2b3d47ff46c admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.379985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922626fc-c921-4980-93f8-f2b3d47ff46c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.380262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922626fc-c921-4980-93f8-f2b3d47ff46c admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.380922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922626fc-c921-4980-93f8-f2b3d47ff46c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.382797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922626fc-c921-4980-93f8-f2b3d47ff46c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.513091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 797/1569] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/projects => generated 371 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:39.513902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb5479-8a20-482d-a5a0-4de8da54d66b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.527348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 773/1570] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/projects => generated 391 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:39.528728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922626fc-c921-4980-93f8-f2b3d47ff46c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.578561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fb5479-8a20-482d-a5a0-4de8da54d66b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.595261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922626fc-c921-4980-93f8-f2b3d47ff46c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.600643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774e92-09f3-4990-b8ba-5a6c25149f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.601319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774e92-09f3-4990-b8ba-5a6c25149f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.601595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774e92-09f3-4990-b8ba-5a6c25149f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.601872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69774e92-09f3-4990-b8ba-5a6c25149f42 admin admin] PATH_INFO: `/v3/projects/0bd9e9c5805645e983a3bec23f37c8ba/users/35b0d1ed01c344acb96ab00c7c163e18/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.617401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69774e92-09f3-4990-b8ba-5a6c25149f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd9e9c5805645e983a3bec23f37c8ba, user_id=35b0d1ed01c344acb96ab00c7c163e18, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.629388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING py.warnings [None req-69774e92-09f3-4990-b8ba-5a6c25149f42 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:51:39.629388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: warnings.warn(msg) Oct 04 08:51:39.629388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: Oct 04 08:51:39.629388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69774e92-09f3-4990-b8ba-5a6c25149f42 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.635840 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5914-d66c-4c73-b232-cf31846f4465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.636468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5914-d66c-4c73-b232-cf31846f4465 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.636752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5914-d66c-4c73-b232-cf31846f4465 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.637028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba5914-d66c-4c73-b232-cf31846f4465 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.637672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5914-d66c-4c73-b232-cf31846f4465 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:51:39.637976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5914-d66c-4c73-b232-cf31846f4465 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.639579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba5914-d66c-4c73-b232-cf31846f4465 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.640956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:39.650908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 798/1571] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:51:39.652352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5914-d66c-4c73-b232-cf31846f4465 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.661249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba5914-d66c-4c73-b232-cf31846f4465 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.665839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ea81b-6f3f-4ab1-8f64-d98bce62e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.666418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ea81b-6f3f-4ab1-8f64-d98bce62e5bb admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.666697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ea81b-6f3f-4ab1-8f64-d98bce62e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.667033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ea81b-6f3f-4ab1-8f64-d98bce62e5bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.668223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ea81b-6f3f-4ab1-8f64-d98bce62e5bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.669766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ea81b-6f3f-4ab1-8f64-d98bce62e5bb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.679875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 799/1572] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:39 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:39.680676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ea81b-6f3f-4ab1-8f64-d98bce62e5bb admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.690128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ea81b-6f3f-4ab1-8f64-d98bce62e5bb admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.694630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50b63b-3957-4da0-b269-37d0b18a4a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.695167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b63b-3957-4da0-b269-37d0b18a4a9e admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.695445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b63b-3957-4da0-b269-37d0b18a4a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.695748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d50b63b-3957-4da0-b269-37d0b18a4a9e admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.696337 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50b63b-3957-4da0-b269-37d0b18a4a9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.698163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d50b63b-3957-4da0-b269-37d0b18a4a9e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.728309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 774/1573] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:39 2022] PUT /identity/v3/projects/0bd9e9c5805645e983a3bec23f37c8ba/users/35b0d1ed01c344acb96ab00c7c163e18/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:39.729134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774e92-09f3-4990-b8ba-5a6c25149f42 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.743016 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:39.789327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69774e92-09f3-4990-b8ba-5a6c25149f42 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.794328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e514-a91c-4b97-9bc0-d7364a1763f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.794930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e514-a91c-4b97-9bc0-d7364a1763f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.795211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e514-a91c-4b97-9bc0-d7364a1763f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.795487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3e514-a91c-4b97-9bc0-d7364a1763f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.796151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3e514-a91c-4b97-9bc0-d7364a1763f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.798033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a3e514-a91c-4b97-9bc0-d7364a1763f2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.854288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 800/1574] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:39.855142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50b63b-3957-4da0-b269-37d0b18a4a9e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.865083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d50b63b-3957-4da0-b269-37d0b18a4a9e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.869656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c20e0-d419-4ce9-9ddc-7d054b409df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.870226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c20e0-d419-4ce9-9ddc-7d054b409df4 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.870509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c20e0-d419-4ce9-9ddc-7d054b409df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.870783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326c20e0-d419-4ce9-9ddc-7d054b409df4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.872123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c20e0-d419-4ce9-9ddc-7d054b409df4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:51:39.872431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c20e0-d419-4ce9-9ddc-7d054b409df4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.874007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326c20e0-d419-4ce9-9ddc-7d054b409df4 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.886715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 801/1575] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:51:39.888760 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c20e0-d419-4ce9-9ddc-7d054b409df4 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:39.898230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326c20e0-d419-4ce9-9ddc-7d054b409df4 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:39.903564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaa0cd-9e28-49d1-a59f-53281113017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:39.904152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaa0cd-9e28-49d1-a59f-53281113017a admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:39.904440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaa0cd-9e28-49d1-a59f-53281113017a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:39.904718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfaa0cd-9e28-49d1-a59f-53281113017a admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:39.905340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaa0cd-9e28-49d1-a59f-53281113017a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:39.907274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfaa0cd-9e28-49d1-a59f-53281113017a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:39.947080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 775/1576] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:39.947847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e514-a91c-4b97-9bc0-d7364a1763f2 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.007248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a3e514-a91c-4b97-9bc0-d7364a1763f2 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.012001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaa363-ea03-4c26-bb2a-81febf066bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.012597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaa363-ea03-4c26-bb2a-81febf066bca admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.012879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaa363-ea03-4c26-bb2a-81febf066bca admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.013152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdaa363-ea03-4c26-bb2a-81febf066bca admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.013775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaa363-ea03-4c26-bb2a-81febf066bca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.015690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdaa363-ea03-4c26-bb2a-81febf066bca admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.037130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 802/1577] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:40.037130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaa0cd-9e28-49d1-a59f-53281113017a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.048003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfaa0cd-9e28-49d1-a59f-53281113017a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.052380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcd60c-aa75-4b0c-9841-23fc63aae9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.052976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcd60c-aa75-4b0c-9841-23fc63aae9fa admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.053253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcd60c-aa75-4b0c-9841-23fc63aae9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.053522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bcd60c-aa75-4b0c-9841-23fc63aae9fa admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.054134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcd60c-aa75-4b0c-9841-23fc63aae9fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.056046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bcd60c-aa75-4b0c-9841-23fc63aae9fa admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.114537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 776/1578] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:39 2022] POST /identity/v3/users => generated 296 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:40.115590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaa363-ea03-4c26-bb2a-81febf066bca admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.124891 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdaa363-ea03-4c26-bb2a-81febf066bca admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.129519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e53981-f338-477c-a65f-2008ded82eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.130095 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e53981-f338-477c-a65f-2008ded82eb1 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.130377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e53981-f338-477c-a65f-2008ded82eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.130652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e53981-f338-477c-a65f-2008ded82eb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.131290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e53981-f338-477c-a65f-2008ded82eb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.132985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e53981-f338-477c-a65f-2008ded82eb1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.142688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 777/1579] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.143904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff443-3d15-4bf1-b364-87252383b915 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.144243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff443-3d15-4bf1-b364-87252383b915 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.144535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ff443-3d15-4bf1-b364-87252383b915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.154900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 803/1580] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:40 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:40.154900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcd60c-aa75-4b0c-9841-23fc63aae9fa admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.164037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bb9ff443-3d15-4bf1-b364-87252383b915 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:40.165426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bb9ff443-3d15-4bf1-b364-87252383b915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:40.219384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bcd60c-aa75-4b0c-9841-23fc63aae9fa admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.224149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df589a-0771-4994-9b62-c79022aaf0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.224755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df589a-0771-4994-9b62-c79022aaf0ca admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.225058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df589a-0771-4994-9b62-c79022aaf0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.225334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df589a-0771-4994-9b62-c79022aaf0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.225714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 778/1581] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:40.225987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df589a-0771-4994-9b62-c79022aaf0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.226528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ff443-3d15-4bf1-b364-87252383b915 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.227681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df589a-0771-4994-9b62-c79022aaf0ca admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.236487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ff443-3d15-4bf1-b364-87252383b915 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.241428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 804/1582] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.241428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df589a-0771-4994-9b62-c79022aaf0ca admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.244471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60130-c893-4d4a-a515-fbfc15885168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.245080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60130-c893-4d4a-a515-fbfc15885168 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.245817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60130-c893-4d4a-a515-fbfc15885168 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.245817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d60130-c893-4d4a-a515-fbfc15885168 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.246293 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d60130-c893-4d4a-a515-fbfc15885168 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.248214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d60130-c893-4d4a-a515-fbfc15885168 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.249031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df589a-0771-4994-9b62-c79022aaf0ca admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.253665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd16de7-8431-43dc-900e-eab9fd003ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.254329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd16de7-8431-43dc-900e-eab9fd003ead admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.254618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd16de7-8431-43dc-900e-eab9fd003ead admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.254895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd16de7-8431-43dc-900e-eab9fd003ead admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.255533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd16de7-8431-43dc-900e-eab9fd003ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.257477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd16de7-8431-43dc-900e-eab9fd003ead admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.265065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:40.352330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 779/1583] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:40 2022] POST /identity/v3/projects => generated 403 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:40.353092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60130-c893-4d4a-a515-fbfc15885168 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.392399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 805/1584] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:40 2022] POST /identity/v3/users => generated 291 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:40.395630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd16de7-8431-43dc-900e-eab9fd003ead admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.406653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd16de7-8431-43dc-900e-eab9fd003ead admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.411239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfdc51-83f2-4c20-a63d-12a1122f1f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.411855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfdc51-83f2-4c20-a63d-12a1122f1f3b admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.412201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfdc51-83f2-4c20-a63d-12a1122f1f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.412492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfdc51-83f2-4c20-a63d-12a1122f1f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.413136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfdc51-83f2-4c20-a63d-12a1122f1f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.414600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d60130-c893-4d4a-a515-fbfc15885168 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.414784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfdc51-83f2-4c20-a63d-12a1122f1f3b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.419265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0602-bb00-4d0c-932d-68c287e872c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.419926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0602-bb00-4d0c-932d-68c287e872c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.420207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0602-bb00-4d0c-932d-68c287e872c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.420482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf0602-bb00-4d0c-932d-68c287e872c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.421125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf0602-bb00-4d0c-932d-68c287e872c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.422687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abf0602-bb00-4d0c-932d-68c287e872c1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.425611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 806/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.426153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfdc51-83f2-4c20-a63d-12a1122f1f3b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.432946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 780/1586] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.433761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0602-bb00-4d0c-932d-68c287e872c1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.435925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfdc51-83f2-4c20-a63d-12a1122f1f3b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.440811 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed1d7e-508e-4e01-9336-a345d3a8f141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.441488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed1d7e-508e-4e01-9336-a345d3a8f141 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.441771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed1d7e-508e-4e01-9336-a345d3a8f141 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.442046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed1d7e-508e-4e01-9336-a345d3a8f141 admin admin] PATH_INFO: `/v3/projects/57c6d8cfd40a456d880acbf08152a856/users/c5b0e93b88ca4175aa575156d19adc2f/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.443255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf0602-bb00-4d0c-932d-68c287e872c1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.447864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0768b-7056-4783-bf12-1466a9b47b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.448442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0768b-7056-4783-bf12-1466a9b47b49 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.448723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0768b-7056-4783-bf12-1466a9b47b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.449516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0768b-7056-4783-bf12-1466a9b47b49 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.450141 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0768b-7056-4783-bf12-1466a9b47b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.452090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0768b-7056-4783-bf12-1466a9b47b49 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.457549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed1d7e-508e-4e01-9336-a345d3a8f141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57c6d8cfd40a456d880acbf08152a856, user_id=c5b0e93b88ca4175aa575156d19adc2f, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.460569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed1d7e-508e-4e01-9336-a345d3a8f141 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.573672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 781/1587] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:40 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:40.575055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0768b-7056-4783-bf12-1466a9b47b49 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.586256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 807/1588] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:40 2022] PUT /identity/v3/projects/57c6d8cfd40a456d880acbf08152a856/users/c5b0e93b88ca4175aa575156d19adc2f/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:40.589130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed1d7e-508e-4e01-9336-a345d3a8f141 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.608874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:40.640244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0768b-7056-4783-bf12-1466a9b47b49 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.660253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed1d7e-508e-4e01-9336-a345d3a8f141 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.665487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb677-30b3-457c-8a40-17240e06d3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.666248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb677-30b3-457c-8a40-17240e06d3db admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.666627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb677-30b3-457c-8a40-17240e06d3db admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.667108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dbb677-30b3-457c-8a40-17240e06d3db admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.668334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbb677-30b3-457c-8a40-17240e06d3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.670594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dbb677-30b3-457c-8a40-17240e06d3db admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.681211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 808/1589] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.682245 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb677-30b3-457c-8a40-17240e06d3db admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.692595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dbb677-30b3-457c-8a40-17240e06d3db admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.696312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc732cab-cd8b-4e9d-bb05-d88af3b05ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.696921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc732cab-cd8b-4e9d-bb05-d88af3b05ade service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.697158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9e677-f9eb-46c8-8f5e-c5a8a55668f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.697329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc732cab-cd8b-4e9d-bb05-d88af3b05ade service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.697473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc732cab-cd8b-4e9d-bb05-d88af3b05ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.697731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e677-f9eb-46c8-8f5e-c5a8a55668f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.698014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e677-f9eb-46c8-8f5e-c5a8a55668f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.698391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f9e677-f9eb-46c8-8f5e-c5a8a55668f3 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.698912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9e677-f9eb-46c8-8f5e-c5a8a55668f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.701398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f9e677-f9eb-46c8-8f5e-c5a8a55668f3 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.707569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc732cab-cd8b-4e9d-bb05-d88af3b05ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.709325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc732cab-cd8b-4e9d-bb05-d88af3b05ade service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.720787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 782/1590] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:40.727685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc732cab-cd8b-4e9d-bb05-d88af3b05ade service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.730671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc732cab-cd8b-4e9d-bb05-d88af3b05ade service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.735298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cd95d-1a26-479a-a8e5-2e53f2cdc3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.735921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cd95d-1a26-479a-a8e5-2e53f2cdc3b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.736200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cd95d-1a26-479a-a8e5-2e53f2cdc3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.736472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cd95d-1a26-479a-a8e5-2e53f2cdc3b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.737112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cd95d-1a26-479a-a8e5-2e53f2cdc3b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.738687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cd95d-1a26-479a-a8e5-2e53f2cdc3b1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.749502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 783/1591] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.752613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cd95d-1a26-479a-a8e5-2e53f2cdc3b1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.760308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cd95d-1a26-479a-a8e5-2e53f2cdc3b1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.765545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2bfee-6b18-4a90-a490-e074b7cb370f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.766130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2bfee-6b18-4a90-a490-e074b7cb370f admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.766404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2bfee-6b18-4a90-a490-e074b7cb370f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.770295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd2bfee-6b18-4a90-a490-e074b7cb370f admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.770295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2bfee-6b18-4a90-a490-e074b7cb370f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.770295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd2bfee-6b18-4a90-a490-e074b7cb370f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.779060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 784/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.780826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2bfee-6b18-4a90-a490-e074b7cb370f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.790286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd2bfee-6b18-4a90-a490-e074b7cb370f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.795408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34711c94-4d3a-4eb3-aa24-0abf4aa6f0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.795994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34711c94-4d3a-4eb3-aa24-0abf4aa6f0cb admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.796271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34711c94-4d3a-4eb3-aa24-0abf4aa6f0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.796544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34711c94-4d3a-4eb3-aa24-0abf4aa6f0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.797151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34711c94-4d3a-4eb3-aa24-0abf4aa6f0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.798745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34711c94-4d3a-4eb3-aa24-0abf4aa6f0cb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.803679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:40.807640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 809/1593] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:40 2022] POST /identity/v3/users => generated 302 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:40.807640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9e677-f9eb-46c8-8f5e-c5a8a55668f3 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.812224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 785/1594] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.812224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c64bda-cf0f-449d-8da2-b879af14ccc7 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.812224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c64bda-cf0f-449d-8da2-b879af14ccc7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.812224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c64bda-cf0f-449d-8da2-b879af14ccc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.817997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f9e677-f9eb-46c8-8f5e-c5a8a55668f3 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.822565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055123b-bcf7-488b-afcd-d709c2c3ece4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.823298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055123b-bcf7-488b-afcd-d709c2c3ece4 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.823616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055123b-bcf7-488b-afcd-d709c2c3ece4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.823890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2055123b-bcf7-488b-afcd-d709c2c3ece4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.824528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055123b-bcf7-488b-afcd-d709c2c3ece4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.826128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2055123b-bcf7-488b-afcd-d709c2c3ece4 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.836993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 810/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.837770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055123b-bcf7-488b-afcd-d709c2c3ece4 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.840891 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-18c64bda-cf0f-449d-8da2-b879af14ccc7 None None] MFA Rules not processed for user `c5b0e93b88ca4175aa575156d19adc2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:40.842100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-18c64bda-cf0f-449d-8da2-b879af14ccc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:40.847635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2055123b-bcf7-488b-afcd-d709c2c3ece4 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.852291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151647d1-e0e8-4f1b-a248-a673dc4b2839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.852897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151647d1-e0e8-4f1b-a248-a673dc4b2839 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.853172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151647d1-e0e8-4f1b-a248-a673dc4b2839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.853441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151647d1-e0e8-4f1b-a248-a673dc4b2839 admin admin] PATH_INFO: `/v3/projects/0c3ab9b85f5a4ef6bf397ad393b4ba6a/users/f799878bf93746b9b8e39539bb95ed36/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.868306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151647d1-e0e8-4f1b-a248-a673dc4b2839 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3ab9b85f5a4ef6bf397ad393b4ba6a, user_id=f799878bf93746b9b8e39539bb95ed36, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.870915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151647d1-e0e8-4f1b-a248-a673dc4b2839 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.904286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 786/1596] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:40.906810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c64bda-cf0f-449d-8da2-b879af14ccc7 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.916304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c64bda-cf0f-449d-8da2-b879af14ccc7 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.921641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a1ba1-7665-4d9f-976e-7155f86ea968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.922440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a1ba1-7665-4d9f-976e-7155f86ea968 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.922721 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a1ba1-7665-4d9f-976e-7155f86ea968 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.922988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a1ba1-7665-4d9f-976e-7155f86ea968 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.923666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a1ba1-7665-4d9f-976e-7155f86ea968 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.925358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a1ba1-7665-4d9f-976e-7155f86ea968 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.940532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 787/1597] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:40.940532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a1ba1-7665-4d9f-976e-7155f86ea968 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:40.948758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a1ba1-7665-4d9f-976e-7155f86ea968 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:40.953336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c5b1-6b19-415c-bcad-00eaa77507d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:40.953968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c5b1-6b19-415c-bcad-00eaa77507d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:40.954245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c5b1-6b19-415c-bcad-00eaa77507d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:40.958460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5c5b1-6b19-415c-bcad-00eaa77507d7 admin admin] PATH_INFO: `/v3/projects/a585bde3a6734feba535505dd1aaace8/users/2d5f07704f014ae7a4997fca3c2faa6c/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:40.969932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c5b1-6b19-415c-bcad-00eaa77507d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a585bde3a6734feba535505dd1aaace8, user_id=2d5f07704f014ae7a4997fca3c2faa6c, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:40.972911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5c5b1-6b19-415c-bcad-00eaa77507d7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:40.994945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 811/1598] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:40 2022] PUT /identity/v3/projects/0c3ab9b85f5a4ef6bf397ad393b4ba6a/users/f799878bf93746b9b8e39539bb95ed36/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:40.995949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151647d1-e0e8-4f1b-a248-a673dc4b2839 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.056787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151647d1-e0e8-4f1b-a248-a673dc4b2839 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.061404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a29c-fac8-487e-882b-4c8ac7991d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.062004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a29c-fac8-487e-882b-4c8ac7991d9c admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.062287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a29c-fac8-487e-882b-4c8ac7991d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.062563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a29c-fac8-487e-882b-4c8ac7991d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.063201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a29c-fac8-487e-882b-4c8ac7991d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.064835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a29c-fac8-487e-882b-4c8ac7991d9c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.074965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 812/1599] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:41.075748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a29c-fac8-487e-882b-4c8ac7991d9c admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.086367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a29c-fac8-487e-882b-4c8ac7991d9c admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.093073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 788/1600] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:40 2022] PUT /identity/v3/projects/a585bde3a6734feba535505dd1aaace8/users/2d5f07704f014ae7a4997fca3c2faa6c/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:41.093073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c5b1-6b19-415c-bcad-00eaa77507d7 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.141680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:41.148950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857d561-216d-47d7-ab81-ab988de04818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.149848 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857d561-216d-47d7-ab81-ab988de04818 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.150007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857d561-216d-47d7-ab81-ab988de04818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.150276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4857d561-216d-47d7-ab81-ab988de04818 admin admin] PATH_INFO: `/v3/projects/ada357b5e1c649b7a3cbb521f904e574/users/878fda3382594191a90cfc011ac52ace/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.163010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5c5b1-6b19-415c-bcad-00eaa77507d7 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.169417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48b57-3f38-4297-aa10-134c58922a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.169983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48b57-3f38-4297-aa10-134c58922a9c admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.170533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48b57-3f38-4297-aa10-134c58922a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.171140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c48b57-3f38-4297-aa10-134c58922a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.172137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48b57-3f38-4297-aa10-134c58922a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.172505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857d561-216d-47d7-ab81-ab988de04818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ada357b5e1c649b7a3cbb521f904e574, user_id=878fda3382594191a90cfc011ac52ace, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.174250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c48b57-3f38-4297-aa10-134c58922a9c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.175907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4857d561-216d-47d7-ab81-ab988de04818 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.187178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 789/1601] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:41.191259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48b57-3f38-4297-aa10-134c58922a9c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.202069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c48b57-3f38-4297-aa10-134c58922a9c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.208170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c13ec-4b5a-4da2-ad6c-8c422015866a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.208170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c13ec-4b5a-4da2-ad6c-8c422015866a admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.208170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c13ec-4b5a-4da2-ad6c-8c422015866a admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.208170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c13ec-4b5a-4da2-ad6c-8c422015866a admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.208750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c13ec-4b5a-4da2-ad6c-8c422015866a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.210957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c13ec-4b5a-4da2-ad6c-8c422015866a admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.285928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 813/1602] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:41 2022] PUT /identity/v3/projects/ada357b5e1c649b7a3cbb521f904e574/users/878fda3382594191a90cfc011ac52ace/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:41.286748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857d561-216d-47d7-ab81-ab988de04818 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.323066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 790/1603] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:41 2022] POST /identity/v3/projects => generated 391 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:41.323640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca51710-e7c4-4ab3-85ce-3b0399dfb65a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.323640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca51710-e7c4-4ab3-85ce-3b0399dfb65a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.323860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca51710-e7c4-4ab3-85ce-3b0399dfb65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.348640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4857d561-216d-47d7-ab81-ab988de04818 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.352953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-fca51710-e7c4-4ab3-85ce-3b0399dfb65a None None] MFA Rules not processed for user `f799878bf93746b9b8e39539bb95ed36`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:41.354209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fca51710-e7c4-4ab3-85ce-3b0399dfb65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:41.371064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:41.416992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e5314d-272a-4205-b445-e76b9080f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.417758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5314d-272a-4205-b445-e76b9080f244 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.418139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5314d-272a-4205-b445-e76b9080f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.418615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e5314d-272a-4205-b445-e76b9080f244 admin admin] PATH_INFO: `/v3/projects/39d9561f5e5147c683280e844dc1d42c/users/b9aef63cad18473994760d8bbc6faae0/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.436567 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5314d-272a-4205-b445-e76b9080f244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d9561f5e5147c683280e844dc1d42c, user_id=b9aef63cad18473994760d8bbc6faae0, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.440639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e5314d-272a-4205-b445-e76b9080f244 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.448755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 791/1604] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:41.450372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca51710-e7c4-4ab3-85ce-3b0399dfb65a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.461737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca51710-e7c4-4ab3-85ce-3b0399dfb65a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.466959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae569f87-c06b-4064-91fe-12042e165319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.467634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569f87-c06b-4064-91fe-12042e165319 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.467927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569f87-c06b-4064-91fe-12042e165319 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.468198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae569f87-c06b-4064-91fe-12042e165319 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.468874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae569f87-c06b-4064-91fe-12042e165319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.470547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae569f87-c06b-4064-91fe-12042e165319 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.480984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 792/1605] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:41.482184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da17a-cf52-4874-b745-1e04775b8dfb None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.482605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da17a-cf52-4874-b745-1e04775b8dfb None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.482884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144da17a-cf52-4874-b745-1e04775b8dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.511404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-144da17a-cf52-4874-b745-1e04775b8dfb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:41.513398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-144da17a-cf52-4874-b745-1e04775b8dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:41.524134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 793/1606] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:41.525392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da17a-cf52-4874-b745-1e04775b8dfb None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.536621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 814/1607] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:41 2022] PUT /identity/v3/projects/39d9561f5e5147c683280e844dc1d42c/users/b9aef63cad18473994760d8bbc6faae0/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:41.536621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36554fe3-1774-4fda-a485-b5e2d5e6a944 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.536621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36554fe3-1774-4fda-a485-b5e2d5e6a944 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.536621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36554fe3-1774-4fda-a485-b5e2d5e6a944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.537142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144da17a-cf52-4874-b745-1e04775b8dfb None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.574931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-36554fe3-1774-4fda-a485-b5e2d5e6a944 None None] MFA Rules not processed for user `878fda3382594191a90cfc011ac52ace`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:41.576950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-36554fe3-1774-4fda-a485-b5e2d5e6a944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:41.615124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3642056-32df-4f9f-94b0-8ff95d2e0d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.622023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3642056-32df-4f9f-94b0-8ff95d2e0d80 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.622023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3642056-32df-4f9f-94b0-8ff95d2e0d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.622023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3642056-32df-4f9f-94b0-8ff95d2e0d80 admin admin] PATH_INFO: `/v3/projects/f4d6ce9c2a5c4f93b73d64a499fe5a66/users/b7ec03a4ed404a1aad608e125d4f0df8/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.632492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3642056-32df-4f9f-94b0-8ff95d2e0d80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4d6ce9c2a5c4f93b73d64a499fe5a66, user_id=b7ec03a4ed404a1aad608e125d4f0df8, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.636591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3642056-32df-4f9f-94b0-8ff95d2e0d80 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.655932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:41.660983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 815/1608] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:41.666090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36554fe3-1774-4fda-a485-b5e2d5e6a944 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.672178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36554fe3-1774-4fda-a485-b5e2d5e6a944 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.676632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb42b-84f0-4d5d-a2bf-30c634e2bac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.677225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb42b-84f0-4d5d-a2bf-30c634e2bac0 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.677516 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb42b-84f0-4d5d-a2bf-30c634e2bac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.677768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01fb42b-84f0-4d5d-a2bf-30c634e2bac0 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.678391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb42b-84f0-4d5d-a2bf-30c634e2bac0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.680321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01fb42b-84f0-4d5d-a2bf-30c634e2bac0 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.754987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 794/1609] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:41 2022] PUT /identity/v3/projects/f4d6ce9c2a5c4f93b73d64a499fe5a66/users/b7ec03a4ed404a1aad608e125d4f0df8/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:41.755875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3642056-32df-4f9f-94b0-8ff95d2e0d80 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.820591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3642056-32df-4f9f-94b0-8ff95d2e0d80 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.825727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81f297-d078-4694-b04b-9aa35766795c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.826338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81f297-d078-4694-b04b-9aa35766795c admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.826621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81f297-d078-4694-b04b-9aa35766795c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.826896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81f297-d078-4694-b04b-9aa35766795c admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.827560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81f297-d078-4694-b04b-9aa35766795c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.829449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f81f297-d078-4694-b04b-9aa35766795c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.882868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 816/1610] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:41 2022] POST /identity/v3/users => generated 302 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:41.883718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb42b-84f0-4d5d-a2bf-30c634e2bac0 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.892865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01fb42b-84f0-4d5d-a2bf-30c634e2bac0 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:41.897350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6e8742-2fc9-4c08-a5cf-b9ffc5f629a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:41.897953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e8742-2fc9-4c08-a5cf-b9ffc5f629a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:41.898229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e8742-2fc9-4c08-a5cf-b9ffc5f629a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:41.898502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6e8742-2fc9-4c08-a5cf-b9ffc5f629a8 admin admin] PATH_INFO: `/v3/projects/f10b2f7a461849a48f16e7f5a0b39881/users/063610aeee1341268b9efa4a3675d45d/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:41.913692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e8742-2fc9-4c08-a5cf-b9ffc5f629a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f10b2f7a461849a48f16e7f5a0b39881, user_id=063610aeee1341268b9efa4a3675d45d, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:41.916414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6e8742-2fc9-4c08-a5cf-b9ffc5f629a8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:41.990896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 795/1611] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:41 2022] POST /identity/v3/projects => generated 379 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:41.990896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81f297-d078-4694-b04b-9aa35766795c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:41.991187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7f81f297-d078-4694-b04b-9aa35766795c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:42.001840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:42.014641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 817/1612] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:41 2022] PUT /identity/v3/projects/f10b2f7a461849a48f16e7f5a0b39881/users/063610aeee1341268b9efa4a3675d45d/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:42.017102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37d208-871a-4c17-86a9-a37e6dcbd118 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.017102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37d208-871a-4c17-86a9-a37e6dcbd118 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.017102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed37d208-871a-4c17-86a9-a37e6dcbd118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.036748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ed37d208-871a-4c17-86a9-a37e6dcbd118 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:42.037962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ed37d208-871a-4c17-86a9-a37e6dcbd118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:42.066284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81f297-d078-4694-b04b-9aa35766795c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.104751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 818/1613] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:42.105861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37d208-871a-4c17-86a9-a37e6dcbd118 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.115892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed37d208-871a-4c17-86a9-a37e6dcbd118 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.119464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417b6d6-bd3c-4eda-9e2e-290511ed3c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.120174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417b6d6-bd3c-4eda-9e2e-290511ed3c7c service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.120391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846f60f-ca20-44d5-b861-418b174b548e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.120532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417b6d6-bd3c-4eda-9e2e-290511ed3c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.121587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f60f-ca20-44d5-b861-418b174b548e admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.121703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417b6d6-bd3c-4eda-9e2e-290511ed3c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.121849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f60f-ca20-44d5-b861-418b174b548e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.122127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f60f-ca20-44d5-b861-418b174b548e admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.122780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846f60f-ca20-44d5-b861-418b174b548e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.124692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846f60f-ca20-44d5-b861-418b174b548e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.130718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417b6d6-bd3c-4eda-9e2e-290511ed3c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.132169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417b6d6-bd3c-4eda-9e2e-290511ed3c7c service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.141657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 796/1614] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:42.145049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5317-3943-4b79-83b9-a7af9570db1d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.145049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5317-3943-4b79-83b9-a7af9570db1d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.145049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502e5317-3943-4b79-83b9-a7af9570db1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.162166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-502e5317-3943-4b79-83b9-a7af9570db1d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:42.163360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-502e5317-3943-4b79-83b9-a7af9570db1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:42.171680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 797/1615] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:42.172388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e5317-3943-4b79-83b9-a7af9570db1d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.181449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502e5317-3943-4b79-83b9-a7af9570db1d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.186848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c780872-8024-42b5-a616-b51773615319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.187446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c780872-8024-42b5-a616-b51773615319 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.187758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c780872-8024-42b5-a616-b51773615319 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.188039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c780872-8024-42b5-a616-b51773615319 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.188667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c780872-8024-42b5-a616-b51773615319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.190245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c780872-8024-42b5-a616-b51773615319 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.200008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 798/1616] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:42.200802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c780872-8024-42b5-a616-b51773615319 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.209758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c780872-8024-42b5-a616-b51773615319 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.214516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecfa0c-19b0-423a-9a2a-5fa308b63353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.215636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfa0c-19b0-423a-9a2a-5fa308b63353 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.215915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfa0c-19b0-423a-9a2a-5fa308b63353 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.216188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ecfa0c-19b0-423a-9a2a-5fa308b63353 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.216795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecfa0c-19b0-423a-9a2a-5fa308b63353 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.218744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ecfa0c-19b0-423a-9a2a-5fa308b63353 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.290005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 819/1617] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:42 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:42.291262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090643-5a7d-46e1-8012-9b748b9581ab None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.291644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090643-5a7d-46e1-8012-9b748b9581ab None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.291920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90090643-5a7d-46e1-8012-9b748b9581ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.310332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-90090643-5a7d-46e1-8012-9b748b9581ab None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:42.311711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-90090643-5a7d-46e1-8012-9b748b9581ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:42.320427 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 799/1618] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:42 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:42.323017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecfa0c-19b0-423a-9a2a-5fa308b63353 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.338090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ecfa0c-19b0-423a-9a2a-5fa308b63353 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.440287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 820/1619] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:42.441872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90090643-5a7d-46e1-8012-9b748b9581ab None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.444813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd3aba-46f3-4ed0-9a15-d1fd8ba23564 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.445502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd3aba-46f3-4ed0-9a15-d1fd8ba23564 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.445788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd3aba-46f3-4ed0-9a15-d1fd8ba23564 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.446060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcd3aba-46f3-4ed0-9a15-d1fd8ba23564 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.458367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90090643-5a7d-46e1-8012-9b748b9581ab None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.463132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763cc46-9309-4655-88a5-5e5ddaf8a994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.463925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763cc46-9309-4655-88a5-5e5ddaf8a994 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.464201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763cc46-9309-4655-88a5-5e5ddaf8a994 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.465364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c763cc46-9309-4655-88a5-5e5ddaf8a994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.475848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd3aba-46f3-4ed0-9a15-d1fd8ba23564 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.477294 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcd3aba-46f3-4ed0-9a15-d1fd8ba23564 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.487358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763cc46-9309-4655-88a5-5e5ddaf8a994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.488904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c763cc46-9309-4655-88a5-5e5ddaf8a994 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.489403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 800/1620] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:42.490217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd3aba-46f3-4ed0-9a15-d1fd8ba23564 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.500545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcd3aba-46f3-4ed0-9a15-d1fd8ba23564 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.503602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 821/1621] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:42.504539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763cc46-9309-4655-88a5-5e5ddaf8a994 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.505786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b1ae5-1d1a-4a70-9880-69286f6b58d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.506440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1ae5-1d1a-4a70-9880-69286f6b58d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.506719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1ae5-1d1a-4a70-9880-69286f6b58d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.506994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b1ae5-1d1a-4a70-9880-69286f6b58d8 admin admin] PATH_INFO: `/v3/projects/a26b19e59c1e48adb80052627d3394b5/users/5ec03cc7caa944c2b7938d536b163b11/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.518754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c763cc46-9309-4655-88a5-5e5ddaf8a994 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.524063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107949ee-fbb5-45bc-ad02-6f9ef017865f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.525018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107949ee-fbb5-45bc-ad02-6f9ef017865f admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.525306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107949ee-fbb5-45bc-ad02-6f9ef017865f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.525629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107949ee-fbb5-45bc-ad02-6f9ef017865f admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.526260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107949ee-fbb5-45bc-ad02-6f9ef017865f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.526843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b1ae5-1d1a-4a70-9880-69286f6b58d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26b19e59c1e48adb80052627d3394b5, user_id=5ec03cc7caa944c2b7938d536b163b11, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.528863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107949ee-fbb5-45bc-ad02-6f9ef017865f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.530203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2b1ae5-1d1a-4a70-9880-69286f6b58d8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.673261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 801/1622] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:42 2022] PUT /identity/v3/projects/a26b19e59c1e48adb80052627d3394b5/users/5ec03cc7caa944c2b7938d536b163b11/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:42.674285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b1ae5-1d1a-4a70-9880-69286f6b58d8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.679953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 822/1623] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:42 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:42.679953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107949ee-fbb5-45bc-ad02-6f9ef017865f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.688795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:42.693204 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107949ee-fbb5-45bc-ad02-6f9ef017865f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.702862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:42.767042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2b1ae5-1d1a-4a70-9880-69286f6b58d8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.768731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc8bab-67ad-4336-b27c-e45fad5d3a5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.769697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc8bab-67ad-4336-b27c-e45fad5d3a5f service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.770396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc8bab-67ad-4336-b27c-e45fad5d3a5f service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.770942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc8bab-67ad-4336-b27c-e45fad5d3a5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.774628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fb152-5f3c-415a-9cd5-2219b534e9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.778838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fb152-5f3c-415a-9cd5-2219b534e9b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.778838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fb152-5f3c-415a-9cd5-2219b534e9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.778838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fb152-5f3c-415a-9cd5-2219b534e9b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.778838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fb152-5f3c-415a-9cd5-2219b534e9b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.780428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fb152-5f3c-415a-9cd5-2219b534e9b1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.782198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc8bab-67ad-4336-b27c-e45fad5d3a5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.783752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc8bab-67ad-4336-b27c-e45fad5d3a5f service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.794742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 802/1624] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:42.794742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fb152-5f3c-415a-9cd5-2219b534e9b1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.795010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 823/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:42.795010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc8bab-67ad-4336-b27c-e45fad5d3a5f service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.804930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fb152-5f3c-415a-9cd5-2219b534e9b1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.806203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc8bab-67ad-4336-b27c-e45fad5d3a5f service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.809923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68680-8c04-4cd3-acb2-b442d3b3bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.813291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68680-8c04-4cd3-acb2-b442d3b3bf7b admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.813291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68680-8c04-4cd3-acb2-b442d3b3bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.813291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a68680-8c04-4cd3-acb2-b442d3b3bf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.813578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36a78-1022-4260-bcd3-945c22aa8d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.813690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a68680-8c04-4cd3-acb2-b442d3b3bf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.813790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36a78-1022-4260-bcd3-945c22aa8d34 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.813790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36a78-1022-4260-bcd3-945c22aa8d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.813790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e36a78-1022-4260-bcd3-945c22aa8d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.814028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a68680-8c04-4cd3-acb2-b442d3b3bf7b admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.816965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36a78-1022-4260-bcd3-945c22aa8d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.829290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 803/1626] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:42.829290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68680-8c04-4cd3-acb2-b442d3b3bf7b admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.830050 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e36a78-1022-4260-bcd3-945c22aa8d34 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.837969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a68680-8c04-4cd3-acb2-b442d3b3bf7b admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.843701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c3c9e-d3f8-4303-980d-05dd47e98748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.844528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c3c9e-d3f8-4303-980d-05dd47e98748 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.844856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c3c9e-d3f8-4303-980d-05dd47e98748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.845350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c3c9e-d3f8-4303-980d-05dd47e98748 admin admin] PATH_INFO: `/v3/projects/65a9e93116b94fceb6014159f0e5c7c5/users/23f9c6b63b2a42418d2ed60647536653/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.857224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 824/1627] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:42 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:42.858478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36a78-1022-4260-bcd3-945c22aa8d34 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.871330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c3c9e-d3f8-4303-980d-05dd47e98748 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a9e93116b94fceb6014159f0e5c7c5, user_id=23f9c6b63b2a42418d2ed60647536653, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.872754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e36a78-1022-4260-bcd3-945c22aa8d34 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.877983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025f157-9dd6-4196-ba38-7e75e2e07ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.878923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c3c9e-d3f8-4303-980d-05dd47e98748 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.879069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025f157-9dd6-4196-ba38-7e75e2e07ae3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.879069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025f157-9dd6-4196-ba38-7e75e2e07ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.879348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025f157-9dd6-4196-ba38-7e75e2e07ae3 admin admin] PATH_INFO: `/v3/projects/a26b19e59c1e48adb80052627d3394b5/users/5ec03cc7caa944c2b7938d536b163b11/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:42.882354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025f157-9dd6-4196-ba38-7e75e2e07ae3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a26b19e59c1e48adb80052627d3394b5, user_id=5ec03cc7caa944c2b7938d536b163b11, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:42.886104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025f157-9dd6-4196-ba38-7e75e2e07ae3 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:42.899758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 825/1628] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:42 2022] PUT /identity/v3/projects/a26b19e59c1e48adb80052627d3394b5/users/5ec03cc7caa944c2b7938d536b163b11/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:42.902014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025f157-9dd6-4196-ba38-7e75e2e07ae3 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:42.992846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025f157-9dd6-4196-ba38-7e75e2e07ae3 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:42.998116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55605949-f8ef-4455-a1fc-8f211f9a35ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:42.998771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605949-f8ef-4455-a1fc-8f211f9a35ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:42.999050 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605949-f8ef-4455-a1fc-8f211f9a35ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:42.999323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55605949-f8ef-4455-a1fc-8f211f9a35ca admin admin] PATH_INFO: `/v3/projects/0e343dad17a845f89d9dd1acf0920b44/users/e943d9ea874d4bd9bf7e273743868113/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:43.015874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55605949-f8ef-4455-a1fc-8f211f9a35ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e343dad17a845f89d9dd1acf0920b44, user_id=e943d9ea874d4bd9bf7e273743868113, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:43.027276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55605949-f8ef-4455-a1fc-8f211f9a35ca admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:43.034614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 804/1629] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:42 2022] PUT /identity/v3/projects/65a9e93116b94fceb6014159f0e5c7c5/users/23f9c6b63b2a42418d2ed60647536653/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:43.034614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e282c-d324-42f7-8f7a-c0f638384b1d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:43.034614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e282c-d324-42f7-8f7a-c0f638384b1d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:43.034876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e282c-d324-42f7-8f7a-c0f638384b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:43.066068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-977e282c-d324-42f7-8f7a-c0f638384b1d None None] MFA Rules not processed for user `5ec03cc7caa944c2b7938d536b163b11`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:43.067455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-977e282c-d324-42f7-8f7a-c0f638384b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:43.142063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 805/1630] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:43 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:43.142063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e282c-d324-42f7-8f7a-c0f638384b1d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:43.222975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e282c-d324-42f7-8f7a-c0f638384b1d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:43.230461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cd1a2-2e49-4463-af50-b4b0d8f880d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:43.231483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cd1a2-2e49-4463-af50-b4b0d8f880d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:43.231851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cd1a2-2e49-4463-af50-b4b0d8f880d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:43.232189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cd1a2-2e49-4463-af50-b4b0d8f880d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:43.233351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cd1a2-2e49-4463-af50-b4b0d8f880d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:43.236204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cd1a2-2e49-4463-af50-b4b0d8f880d2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:43.250905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 806/1631] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:43.250905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cd1a2-2e49-4463-af50-b4b0d8f880d2 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:43.311571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 826/1632] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:42 2022] PUT /identity/v3/projects/0e343dad17a845f89d9dd1acf0920b44/users/e943d9ea874d4bd9bf7e273743868113/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:43.311571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55605949-f8ef-4455-a1fc-8f211f9a35ca admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:43.341365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cd1a2-2e49-4463-af50-b4b0d8f880d2 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:43.401012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55605949-f8ef-4455-a1fc-8f211f9a35ca admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:43.412736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8aac-d37e-4bb4-b6fa-46d81b3987e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:43.412736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8aac-d37e-4bb4-b6fa-46d81b3987e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:43.412736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8aac-d37e-4bb4-b6fa-46d81b3987e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:43.424863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab8aac-d37e-4bb4-b6fa-46d81b3987e4 admin admin] PATH_INFO: `/v3/projects/65a9e93116b94fceb6014159f0e5c7c5/users/23f9c6b63b2a42418d2ed60647536653/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:43.430552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8aac-d37e-4bb4-b6fa-46d81b3987e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65a9e93116b94fceb6014159f0e5c7c5, user_id=23f9c6b63b2a42418d2ed60647536653, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:43.434304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab8aac-d37e-4bb4-b6fa-46d81b3987e4 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:43.438053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc8bbc-0405-4f6c-9e80-2d12119f659b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:43.441181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc8bbc-0405-4f6c-9e80-2d12119f659b service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:43.441181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc8bbc-0405-4f6c-9e80-2d12119f659b service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:43.441181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc8bbc-0405-4f6c-9e80-2d12119f659b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:43.447218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:43.454109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 827/1633] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:43 2022] PUT /identity/v3/projects/65a9e93116b94fceb6014159f0e5c7c5/users/23f9c6b63b2a42418d2ed60647536653/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:43.466354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8aac-d37e-4bb4-b6fa-46d81b3987e4 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:43.518734 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:43.561211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc8bbc-0405-4f6c-9e80-2d12119f659b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:43.563580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc8bbc-0405-4f6c-9e80-2d12119f659b service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:43.581310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab8aac-d37e-4bb4-b6fa-46d81b3987e4 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:43.583405 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 807/1634] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:43 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:43.584781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ee69-de99-465c-92b7-117f86863599 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:43.585320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ee69-de99-465c-92b7-117f86863599 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:43.585600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a9ee69-de99-465c-92b7-117f86863599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:43.587391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456fe69-21a7-4db7-9b06-3e2b41fe4a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:43.592339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456fe69-21a7-4db7-9b06-3e2b41fe4a53 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:43.592339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456fe69-21a7-4db7-9b06-3e2b41fe4a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:43.592339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456fe69-21a7-4db7-9b06-3e2b41fe4a53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:43.592339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456fe69-21a7-4db7-9b06-3e2b41fe4a53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:43.592339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456fe69-21a7-4db7-9b06-3e2b41fe4a53 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:43.604777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 828/1635] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:43.609753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456fe69-21a7-4db7-9b06-3e2b41fe4a53 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:43.624935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456fe69-21a7-4db7-9b06-3e2b41fe4a53 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:43.631564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2a89f-f39a-47a4-b879-6943e3fa3f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:43.632492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a89f-f39a-47a4-b879-6943e3fa3f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:43.632963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a89f-f39a-47a4-b879-6943e3fa3f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:43.633680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2a89f-f39a-47a4-b879-6943e3fa3f50 admin admin] PATH_INFO: `/v3/projects/0e343dad17a845f89d9dd1acf0920b44/users/e943d9ea874d4bd9bf7e273743868113/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:43.636251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a89f-f39a-47a4-b879-6943e3fa3f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e343dad17a845f89d9dd1acf0920b44, user_id=e943d9ea874d4bd9bf7e273743868113, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:43.640379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2a89f-f39a-47a4-b879-6943e3fa3f50 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:43.656305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-16a9ee69-de99-465c-92b7-117f86863599 None None] MFA Rules not processed for user `23f9c6b63b2a42418d2ed60647536653`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:43.658749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-16a9ee69-de99-465c-92b7-117f86863599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:43.676143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 829/1636] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:43 2022] PUT /identity/v3/projects/0e343dad17a845f89d9dd1acf0920b44/users/e943d9ea874d4bd9bf7e273743868113/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:43.691283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b601c92-7071-435d-b927-8d1e5ce94655 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:43.691701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b601c92-7071-435d-b927-8d1e5ce94655 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:43.691868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b601c92-7071-435d-b927-8d1e5ce94655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:43.816308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9b601c92-7071-435d-b927-8d1e5ce94655 None None] MFA Rules not processed for user `e943d9ea874d4bd9bf7e273743868113`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:43.818225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9b601c92-7071-435d-b927-8d1e5ce94655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:43.865632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 808/1637] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:43 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:43.865632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9ee69-de99-465c-92b7-117f86863599 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:43.934855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 830/1638] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:43.937616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b601c92-7071-435d-b927-8d1e5ce94655 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:44.288832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a9ee69-de99-465c-92b7-117f86863599 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:44.288832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4184b-4c2f-4f73-b873-927d6e643c9a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:44.288832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4184b-4c2f-4f73-b873-927d6e643c9a service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:44.288832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4184b-4c2f-4f73-b873-927d6e643c9a service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:44.291692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c4184b-4c2f-4f73-b873-927d6e643c9a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:44.297609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b601c92-7071-435d-b927-8d1e5ce94655 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:44.297609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf36f0-c1a3-402c-bcf5-cda4be93025d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:44.297609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf36f0-c1a3-402c-bcf5-cda4be93025d service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:44.297609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf36f0-c1a3-402c-bcf5-cda4be93025d service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:44.301589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbf36f0-c1a3-402c-bcf5-cda4be93025d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:44.301589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf36f0-c1a3-402c-bcf5-cda4be93025d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:44.301589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbf36f0-c1a3-402c-bcf5-cda4be93025d service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:44.301589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 831/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:43 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:44.305394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4184b-4c2f-4f73-b873-927d6e643c9a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:44.305394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c4184b-4c2f-4f73-b873-927d6e643c9a service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:44.305394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 809/1640] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:43 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:44.358220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf36f0-c1a3-402c-bcf5-cda4be93025d service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:44.368938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbf36f0-c1a3-402c-bcf5-cda4be93025d service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:44.374024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e9cd31-1ebc-41f1-8a68-1728a1cc453c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:44.374647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9cd31-1ebc-41f1-8a68-1728a1cc453c service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:44.374930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9cd31-1ebc-41f1-8a68-1728a1cc453c service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:44.375201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e9cd31-1ebc-41f1-8a68-1728a1cc453c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:44.385961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9cd31-1ebc-41f1-8a68-1728a1cc453c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:44.400073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e9cd31-1ebc-41f1-8a68-1728a1cc453c service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:44.412951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 832/1641] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:44.766263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:44.897518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4184b-4c2f-4f73-b873-927d6e643c9a service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:44.912320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c4184b-4c2f-4f73-b873-927d6e643c9a service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:44.919718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924971b9-9e6c-4e32-a485-8244377211ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:44.920695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924971b9-9e6c-4e32-a485-8244377211ef service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:44.921421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924971b9-9e6c-4e32-a485-8244377211ef service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:44.921923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924971b9-9e6c-4e32-a485-8244377211ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:44.995470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:45.007551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924971b9-9e6c-4e32-a485-8244377211ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:45.009184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924971b9-9e6c-4e32-a485-8244377211ef service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:45.019840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 810/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:46.388822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c20b54-908b-4872-bbb8-3be35fc6e7a8 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:46.389321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c20b54-908b-4872-bbb8-3be35fc6e7a8 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:46.389408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c20b54-908b-4872-bbb8-3be35fc6e7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:46.442656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b1c20b54-908b-4872-bbb8-3be35fc6e7a8 None None] MFA Rules not processed for user `063610aeee1341268b9efa4a3675d45d`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:46.443925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b1c20b54-908b-4872-bbb8-3be35fc6e7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:46.539792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 833/1643] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:46 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:51:46.545351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924971b9-9e6c-4e32-a485-8244377211ef service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:46.573447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c20b54-908b-4872-bbb8-3be35fc6e7a8 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:46.635184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:46.696155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924971b9-9e6c-4e32-a485-8244377211ef service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:46.707757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c20b54-908b-4872-bbb8-3be35fc6e7a8 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:46.710851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b378d2-886f-4caa-92b8-a035f4e7deed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:46.711915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b378d2-886f-4caa-92b8-a035f4e7deed admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:46.712057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b378d2-886f-4caa-92b8-a035f4e7deed admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:46.712261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b378d2-886f-4caa-92b8-a035f4e7deed admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:46.712950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b378d2-886f-4caa-92b8-a035f4e7deed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:46.716915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b378d2-886f-4caa-92b8-a035f4e7deed admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:46.717645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:46.718304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:46.718582 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:46.718861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] PATH_INFO: `/v3/users/878fda3382594191a90cfc011ac52ace` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:46.724833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] RBAC: Authorizing `identity:delete_user(user_id=878fda3382594191a90cfc011ac52ace)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:46.729541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:46.892090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 811/1644] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:46 2022] POST /identity/v3/projects => generated 403 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:46.893500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b378d2-886f-4caa-92b8-a035f4e7deed admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:46.983904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b378d2-886f-4caa-92b8-a035f4e7deed admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:46.994161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72478c0a-d106-410e-95f8-78309a708696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:46.995738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72478c0a-d106-410e-95f8-78309a708696 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:46.996064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72478c0a-d106-410e-95f8-78309a708696 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:46.996338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72478c0a-d106-410e-95f8-78309a708696 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:46.996989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72478c0a-d106-410e-95f8-78309a708696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:47.003004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72478c0a-d106-410e-95f8-78309a708696 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:47.018205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '878fda3382594191a90cfc011ac52ace'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:47.053060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '878fda3382594191a90cfc011ac52ace'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:47.054096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '878fda3382594191a90cfc011ac52ace'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:47.055881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '878fda3382594191a90cfc011ac52ace'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:47.169684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dde227ca-3997-4622-afb3-44b8a3b3caac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '878fda3382594191a90cfc011ac52ace'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:47.183922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 812/1645] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:46 2022] POST /identity/v3/users => generated 308 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:47.187838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72478c0a-d106-410e-95f8-78309a708696 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:47.195746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-72478c0a-d106-410e-95f8-78309a708696 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:47.225246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 834/1646] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:51:46 2022] DELETE /identity/v3/users/878fda3382594191a90cfc011ac52ace => generated 0 bytes in 652 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:47.229875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cd787-806e-4cbd-bf18-3dd565632efa None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:47.230478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cd787-806e-4cbd-bf18-3dd565632efa None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:47.231199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cd787-806e-4cbd-bf18-3dd565632efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:47.239137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72478c0a-d106-410e-95f8-78309a708696 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:47.273288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:47.292828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-239cd787-806e-4cbd-bf18-3dd565632efa None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:47.296943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-239cd787-806e-4cbd-bf18-3dd565632efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:47.387696 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff748-5af5-4ac3-940c-148b9c88e69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:47.387950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff748-5af5-4ac3-940c-148b9c88e69c admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:47.388061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff748-5af5-4ac3-940c-148b9c88e69c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:47.388291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dff748-5af5-4ac3-940c-148b9c88e69c admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:47.390288 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dff748-5af5-4ac3-940c-148b9c88e69c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:47.395472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dff748-5af5-4ac3-940c-148b9c88e69c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:47.422796 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 813/1647] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:47.424549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff748-5af5-4ac3-940c-148b9c88e69c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:47.437881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 835/1648] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:47.450917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dff748-5af5-4ac3-940c-148b9c88e69c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:47.452279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cd787-806e-4cbd-bf18-3dd565632efa None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:47.453931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-239cd787-806e-4cbd-bf18-3dd565632efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:47.462981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e7279-489e-4f9c-852c-744d2fac55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:47.466594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e7279-489e-4f9c-852c-744d2fac55c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:47.466594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e7279-489e-4f9c-852c-744d2fac55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:47.466594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712e7279-489e-4f9c-852c-744d2fac55c3 admin admin] PATH_INFO: `/v3/projects/68cf552ee9724bfd97c612d66111fde7/users/3f79408c57ac4ccfa4cb609137ba9122/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:47.496772 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e7279-489e-4f9c-852c-744d2fac55c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68cf552ee9724bfd97c612d66111fde7, user_id=3f79408c57ac4ccfa4cb609137ba9122, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:47.501454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712e7279-489e-4f9c-852c-744d2fac55c3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:47.561084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cd787-806e-4cbd-bf18-3dd565632efa None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:47.568468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d73df-0424-4610-bbb3-be388c4c3b73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:47.568468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d73df-0424-4610-bbb3-be388c4c3b73 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:47.568468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d73df-0424-4610-bbb3-be388c4c3b73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:47.568468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d73df-0424-4610-bbb3-be388c4c3b73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:47.582683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d73df-0424-4610-bbb3-be388c4c3b73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:47.585172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d73df-0424-4610-bbb3-be388c4c3b73 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:47.599209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 836/1649] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:51:47.647769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 814/1650] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:47 2022] PUT /identity/v3/projects/68cf552ee9724bfd97c612d66111fde7/users/3f79408c57ac4ccfa4cb609137ba9122/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:47.652036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d73df-0424-4610-bbb3-be388c4c3b73 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:47.684513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d73df-0424-4610-bbb3-be388c4c3b73 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:47.839611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e0bd-4cd3-4eb2-ac8c-1cd04b03b0cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:47.840491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e0bd-4cd3-4eb2-ac8c-1cd04b03b0cb admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:47.841158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e0bd-4cd3-4eb2-ac8c-1cd04b03b0cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:47.841590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070e0bd-4cd3-4eb2-ac8c-1cd04b03b0cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:47.842642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070e0bd-4cd3-4eb2-ac8c-1cd04b03b0cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:47.846593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070e0bd-4cd3-4eb2-ac8c-1cd04b03b0cb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:47.910859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 837/1651] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:47.910968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e7279-489e-4f9c-852c-744d2fac55c3 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:47.928014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712e7279-489e-4f9c-852c-744d2fac55c3 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:47.940157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f022a-298b-4974-a147-03f455468b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:47.944126 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f022a-298b-4974-a147-03f455468b06 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:47.944833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f022a-298b-4974-a147-03f455468b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:47.945275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0f022a-298b-4974-a147-03f455468b06 admin admin] PATH_INFO: `/v3/projects/68cf552ee9724bfd97c612d66111fde7/users/3f79408c57ac4ccfa4cb609137ba9122/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:47.958153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f022a-298b-4974-a147-03f455468b06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68cf552ee9724bfd97c612d66111fde7, user_id=3f79408c57ac4ccfa4cb609137ba9122, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:47.964108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0f022a-298b-4974-a147-03f455468b06 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:47.992268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 815/1652] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:47 2022] PUT /identity/v3/projects/68cf552ee9724bfd97c612d66111fde7/users/3f79408c57ac4ccfa4cb609137ba9122/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:50.244123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e0bd-4cd3-4eb2-ac8c-1cd04b03b0cb admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:50.244123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a070e0bd-4cd3-4eb2-ac8c-1cd04b03b0cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:50.258087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070e0bd-4cd3-4eb2-ac8c-1cd04b03b0cb admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:50.475611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:50.491192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:50.504431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:50.504841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:50.505911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] PATH_INFO: `/v3/projects/ada357b5e1c649b7a3cbb521f904e574` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:50.508920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ada357b5e1c649b7a3cbb521f904e574)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:50.510027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: WARNING py.warnings [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:51:50.510027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: warnings.warn(msg) Oct 04 08:51:50.510027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: Oct 04 08:51:50.831662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:50.997930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ada357b5e1c649b7a3cbb521f904e574', 'request_id': 'req-b23509b6-e43d-4d96-bc07-a47f2f22918e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.130708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ada357b5e1c649b7a3cbb521f904e574', 'request_id': 'req-b23509b6-e43d-4d96-bc07-a47f2f22918e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.172423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ada357b5e1c649b7a3cbb521f904e574', 'request_id': 'req-b23509b6-e43d-4d96-bc07-a47f2f22918e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.190187 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] The token cache is being invalidate because project ada357b5e1c649b7a3cbb521f904e574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:51:51.190489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.191182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.194694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 838/1653] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:51:50 2022] DELETE /identity/v3/projects/ada357b5e1c649b7a3cbb521f904e574 => generated 0 bytes in 958 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:51:51.199811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f022a-298b-4974-a147-03f455468b06 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:51.202360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ee0f022a-298b-4974-a147-03f455468b06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:51.235730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0f022a-298b-4974-a147-03f455468b06 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:51.256892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:51.332423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:51.333873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:51.334359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:51.334820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] PATH_INFO: `/v3/users/e943d9ea874d4bd9bf7e273743868113` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:51.337113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e943d9ea874d4bd9bf7e273743868113)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:51.338356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: WARNING py.warnings [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 04 08:51:51.338356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: warnings.warn(msg) Oct 04 08:51:51.338356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: Oct 04 08:51:51.340894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:51.709614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e943d9ea874d4bd9bf7e273743868113'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.768983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e943d9ea874d4bd9bf7e273743868113'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.771138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e943d9ea874d4bd9bf7e273743868113'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.772448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e943d9ea874d4bd9bf7e273743868113'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.791338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:51.793508 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:51.807177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23509b6-e43d-4d96-bc07-a47f2f22918e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:51.821055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:51.821055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:51.821055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:51.821055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] PATH_INFO: `/v3/users/c5b0e93b88ca4175aa575156d19adc2f` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:51.821409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5b0e93b88ca4175aa575156d19adc2f)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:51.825291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:51.912706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-93dacf78-722a-4e40-b9ea-1424b2335c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e943d9ea874d4bd9bf7e273743868113'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:51.969487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 816/1654] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:51:51 2022] DELETE /identity/v3/users/e943d9ea874d4bd9bf7e273743868113 => generated 0 bytes in 772 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:52.220769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5b0e93b88ca4175aa575156d19adc2f'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:52.232135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5b0e93b88ca4175aa575156d19adc2f'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:52.233047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5b0e93b88ca4175aa575156d19adc2f'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:52.233985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5b0e93b88ca4175aa575156d19adc2f'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:52.426515 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5b0e93b88ca4175aa575156d19adc2f'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:52.475639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 839/1655] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:51:51 2022] DELETE /identity/v3/users/c5b0e93b88ca4175aa575156d19adc2f => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:51:52.478117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8252a-720a-4d95-b033-63555de4f9fb None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:52.478501 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8252a-720a-4d95-b033-63555de4f9fb None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:52.478835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba8252a-720a-4d95-b033-63555de4f9fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:52.556531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-dba8252a-720a-4d95-b033-63555de4f9fb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:52.561823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-dba8252a-720a-4d95-b033-63555de4f9fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:52.700220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 817/1656] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:52.734042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:52.735930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:52.846237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:52.849829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2178f1-5096-40aa-922a-26888a7d100f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:52.860645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1486d00-5b24-44e6-af4a-10915cd1076c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:52.862159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1486d00-5b24-44e6-af4a-10915cd1076c service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:52.862705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1486d00-5b24-44e6-af4a-10915cd1076c service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:52.864100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1486d00-5b24-44e6-af4a-10915cd1076c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:52.876859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1486d00-5b24-44e6-af4a-10915cd1076c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:52.878481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1486d00-5b24-44e6-af4a-10915cd1076c service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:52.889266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca572-03fa-4038-8f83-1714a0ac0214 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:52.889793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca572-03fa-4038-8f83-1714a0ac0214 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:52.890219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7ca572-03fa-4038-8f83-1714a0ac0214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:52.916291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 840/1657] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:52.944879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-dd7ca572-03fa-4038-8f83-1714a0ac0214 None None] MFA Rules not processed for user `3f79408c57ac4ccfa4cb609137ba9122`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:52.946110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-dd7ca572-03fa-4038-8f83-1714a0ac0214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:53.142661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 818/1658] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:51:53.564877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25ca5-9178-4b59-b90f-e828bd184ba7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:53.565170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25ca5-9178-4b59-b90f-e828bd184ba7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:53.565456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a25ca5-9178-4b59-b90f-e828bd184ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:53.599124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ca572-03fa-4038-8f83-1714a0ac0214 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:53.600080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-dd7ca572-03fa-4038-8f83-1714a0ac0214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:53.630831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7ca572-03fa-4038-8f83-1714a0ac0214 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:53.639381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:53.645332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b1a25ca5-9178-4b59-b90f-e828bd184ba7 None None] MFA Rules not processed for user `35b0d1ed01c344acb96ab00c7c163e18`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:53.648673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b1a25ca5-9178-4b59-b90f-e828bd184ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:53.655748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:53.656417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:53.656702 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:53.656991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] PATH_INFO: `/v3/projects/0e343dad17a845f89d9dd1acf0920b44` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:53.658432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e343dad17a845f89d9dd1acf0920b44)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:53.660389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:53.831572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 841/1659] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:53.872791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2950-461f-47ee-9230-63117fccddff None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:53.873432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2950-461f-47ee-9230-63117fccddff None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:53.875581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26e2950-461f-47ee-9230-63117fccddff None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:53.877009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 842/1660] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 08:51:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:51:53.886576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec98c5-f0c1-4351-894d-76d67a64cec3 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:53.887932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec98c5-f0c1-4351-894d-76d67a64cec3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:53.888212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec98c5-f0c1-4351-894d-76d67a64cec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:53.943317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e343dad17a845f89d9dd1acf0920b44', 'request_id': 'req-69d04ed6-3aa6-48ef-ba89-15cb66dac989'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:53.957837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-19ec98c5-f0c1-4351-894d-76d67a64cec3 None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:53.959387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-19ec98c5-f0c1-4351-894d-76d67a64cec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:54.083617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e343dad17a845f89d9dd1acf0920b44', 'request_id': 'req-69d04ed6-3aa6-48ef-ba89-15cb66dac989'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:54.084084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 843/1661] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:51:54.092203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e343dad17a845f89d9dd1acf0920b44', 'request_id': 'req-69d04ed6-3aa6-48ef-ba89-15cb66dac989'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:54.093976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec98c5-f0c1-4351-894d-76d67a64cec3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:54.108174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec98c5-f0c1-4351-894d-76d67a64cec3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:54.119311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892c10a2-7381-4b4e-b761-ffaeb3c3eb06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:54.120020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] The token cache is being invalidate because project 0e343dad17a845f89d9dd1acf0920b44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:51:54.120148 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c10a2-7381-4b4e-b761-ffaeb3c3eb06 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:54.120341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c10a2-7381-4b4e-b761-ffaeb3c3eb06 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:54.120566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892c10a2-7381-4b4e-b761-ffaeb3c3eb06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:54.121108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:54.122502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69d04ed6-3aa6-48ef-ba89-15cb66dac989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:54.124647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 819/1662] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:51:53 2022] DELETE /identity/v3/projects/0e343dad17a845f89d9dd1acf0920b44 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:54.130631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944850c9-9914-4b51-9a2b-a094fc332aba None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:54.131142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944850c9-9914-4b51-9a2b-a094fc332aba None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:54.131678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944850c9-9914-4b51-9a2b-a094fc332aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:54.174945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-944850c9-9914-4b51-9a2b-a094fc332aba None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:54.177813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-944850c9-9914-4b51-9a2b-a094fc332aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:54.228079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c10a2-7381-4b4e-b761-ffaeb3c3eb06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:54.233342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892c10a2-7381-4b4e-b761-ffaeb3c3eb06 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:54.240828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 844/1663] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:54 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:54.317616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 820/1664] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:54.323914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd02e67-9fc9-45a5-80ac-0caa39188a97 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:54.324147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd02e67-9fc9-45a5-80ac-0caa39188a97 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:54.325060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd02e67-9fc9-45a5-80ac-0caa39188a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:54.360998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-1fd02e67-9fc9-45a5-80ac-0caa39188a97 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:54.362329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1fd02e67-9fc9-45a5-80ac-0caa39188a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:54.401395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944850c9-9914-4b51-9a2b-a094fc332aba None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:54.403799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 845/1665] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:54.420275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944850c9-9914-4b51-9a2b-a094fc332aba None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:54.433175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbf173-0050-43df-90b6-4ba99b352ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:54.434645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbf173-0050-43df-90b6-4ba99b352ac0 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:54.435084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbf173-0050-43df-90b6-4ba99b352ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:54.435538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbf173-0050-43df-90b6-4ba99b352ac0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:54.436388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbf173-0050-43df-90b6-4ba99b352ac0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:51:54.436887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbf173-0050-43df-90b6-4ba99b352ac0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:54.438703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbf173-0050-43df-90b6-4ba99b352ac0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:54.464178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 821/1666] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:51:54.470621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd02e67-9fc9-45a5-80ac-0caa39188a97 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:54.485522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd02e67-9fc9-45a5-80ac-0caa39188a97 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:54.499860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef301aa-bde5-47f9-8487-1d889cd1367b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:54.500809 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef301aa-bde5-47f9-8487-1d889cd1367b admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:54.501270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef301aa-bde5-47f9-8487-1d889cd1367b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:54.501713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef301aa-bde5-47f9-8487-1d889cd1367b admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:54.502541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef301aa-bde5-47f9-8487-1d889cd1367b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:54.504709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef301aa-bde5-47f9-8487-1d889cd1367b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:54.672807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 846/1667] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:54 2022] POST /identity/v3/projects => generated 363 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:54.673469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbf173-0050-43df-90b6-4ba99b352ac0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:54.696124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbf173-0050-43df-90b6-4ba99b352ac0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:54.811396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867631a-941d-411a-94ed-4b44381cc8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:54.812068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867631a-941d-411a-94ed-4b44381cc8f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:54.812354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867631a-941d-411a-94ed-4b44381cc8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:54.812787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7867631a-941d-411a-94ed-4b44381cc8f0 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:54.813680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867631a-941d-411a-94ed-4b44381cc8f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:54.816245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7867631a-941d-411a-94ed-4b44381cc8f0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:55.010494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 822/1668] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:54 2022] POST /identity/v3/users => generated 282 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:55.015683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef301aa-bde5-47f9-8487-1d889cd1367b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:55.028232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef301aa-bde5-47f9-8487-1d889cd1367b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:55.063139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b30a-0b24-4fe7-831c-8b7409de47cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:55.063139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b30a-0b24-4fe7-831c-8b7409de47cd admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:55.063139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b30a-0b24-4fe7-831c-8b7409de47cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:55.063139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d32b30a-0b24-4fe7-831c-8b7409de47cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:55.063423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32b30a-0b24-4fe7-831c-8b7409de47cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:55.063423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d32b30a-0b24-4fe7-831c-8b7409de47cd admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:55.089860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 847/1669] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:55.099597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867631a-941d-411a-94ed-4b44381cc8f0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:55.114744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7867631a-941d-411a-94ed-4b44381cc8f0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:55.126955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5cb0-0bd4-4489-b8e6-b76fa12cc7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:55.130940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5cb0-0bd4-4489-b8e6-b76fa12cc7c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:55.130940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5cb0-0bd4-4489-b8e6-b76fa12cc7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:55.130940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86a5cb0-0bd4-4489-b8e6-b76fa12cc7c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:55.130940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5cb0-0bd4-4489-b8e6-b76fa12cc7c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:55.135362 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86a5cb0-0bd4-4489-b8e6-b76fa12cc7c3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:55.144638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b30a-0b24-4fe7-831c-8b7409de47cd admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:55.146940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6d32b30a-0b24-4fe7-831c-8b7409de47cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:55.176858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 823/1670] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:55.177787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d32b30a-0b24-4fe7-831c-8b7409de47cd admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:55.180750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5cb0-0bd4-4489-b8e6-b76fa12cc7c3 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:55.196067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:55.196732 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:55.197019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:55.200220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] PATH_INFO: `/v3/projects/57c6d8cfd40a456d880acbf08152a856` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:55.202825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=57c6d8cfd40a456d880acbf08152a856)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:55.211053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:55.218897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86a5cb0-0bd4-4489-b8e6-b76fa12cc7c3 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:55.243736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272c872-8571-4d5c-bb4d-f23151eca45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:55.244438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c872-8571-4d5c-bb4d-f23151eca45d admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:55.247761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c872-8571-4d5c-bb4d-f23151eca45d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:55.248070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272c872-8571-4d5c-bb4d-f23151eca45d admin admin] PATH_INFO: `/v3/projects/b316ad86a2d0422b8316e2ca3711cfde/users/8b3634a49783446dbf436da8e80e2df5/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:55.292657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272c872-8571-4d5c-bb4d-f23151eca45d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b316ad86a2d0422b8316e2ca3711cfde, user_id=8b3634a49783446dbf436da8e80e2df5, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:55.303425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272c872-8571-4d5c-bb4d-f23151eca45d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:55.454960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 824/1671] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:55 2022] PUT /identity/v3/projects/b316ad86a2d0422b8316e2ca3711cfde/users/8b3634a49783446dbf436da8e80e2df5/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:55.463932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a153-912b-404f-8e78-010e68c4111d None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:55.463932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a153-912b-404f-8e78-010e68c4111d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:55.463932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a153-912b-404f-8e78-010e68c4111d None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:55.463932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 825/1672] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:51:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:51:55.486772 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315d533-9794-4573-943c-f727cc5533bb None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:55.486772 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315d533-9794-4573-943c-f727cc5533bb None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:55.486772 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1315d533-9794-4573-943c-f727cc5533bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:55.486981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57c6d8cfd40a456d880acbf08152a856', 'request_id': 'req-5ca37086-f254-47a5-b30c-b75c5727d6fe'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:55.551450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1315d533-9794-4573-943c-f727cc5533bb None None] MFA Rules not processed for user `8b3634a49783446dbf436da8e80e2df5`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:55.554038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1315d533-9794-4573-943c-f727cc5533bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:55.630556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57c6d8cfd40a456d880acbf08152a856', 'request_id': 'req-5ca37086-f254-47a5-b30c-b75c5727d6fe'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:55.664016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57c6d8cfd40a456d880acbf08152a856', 'request_id': 'req-5ca37086-f254-47a5-b30c-b75c5727d6fe'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:55.689525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] The token cache is being invalidate because project 57c6d8cfd40a456d880acbf08152a856 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:51:55.689836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:55.692622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ca37086-f254-47a5-b30c-b75c5727d6fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:55.694536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 848/1673] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:51:55 2022] DELETE /identity/v3/projects/57c6d8cfd40a456d880acbf08152a856 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:51:55.699756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5939-42b9-4d74-83a0-70d0cb91b846 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:55.700095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5939-42b9-4d74-83a0-70d0cb91b846 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:55.700383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b5939-42b9-4d74-83a0-70d0cb91b846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:55.763520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-cd1b5939-42b9-4d74-83a0-70d0cb91b846 None None] MFA Rules not processed for user `22aa2b6e4b854de4868b75cc9626b8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:55.763520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cd1b5939-42b9-4d74-83a0-70d0cb91b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:55.779242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 826/1674] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:55 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:55.780395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296216a8-ff72-4858-b49b-cd3adfe47fc8 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:55.780686 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296216a8-ff72-4858-b49b-cd3adfe47fc8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:55.780982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296216a8-ff72-4858-b49b-cd3adfe47fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:55.859377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-296216a8-ff72-4858-b49b-cd3adfe47fc8 None None] MFA Rules not processed for user `b7ec03a4ed404a1aad608e125d4f0df8`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:55.860934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-296216a8-ff72-4858-b49b-cd3adfe47fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:55.907116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 849/1675] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:51:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:55.911915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b5939-42b9-4d74-83a0-70d0cb91b846 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:55.918787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cd1b5939-42b9-4d74-83a0-70d0cb91b846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:56.001425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 827/1676] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:56.015857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296216a8-ff72-4858-b49b-cd3adfe47fc8 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:56.022512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-296216a8-ff72-4858-b49b-cd3adfe47fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:56.072615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b5939-42b9-4d74-83a0-70d0cb91b846 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:56.086371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:56.086577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:56.087265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:56.087265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] PATH_INFO: `/v3/users/5ec03cc7caa944c2b7938d536b163b11` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:56.089550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec03cc7caa944c2b7938d536b163b11)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:56.092451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:56.163985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296216a8-ff72-4858-b49b-cd3adfe47fc8 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:56.170131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c97895-2fab-4edb-ab66-37490da43dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:56.170864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c97895-2fab-4edb-ab66-37490da43dcf admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:56.171243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c97895-2fab-4edb-ab66-37490da43dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:56.171673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c97895-2fab-4edb-ab66-37490da43dcf admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:56.172432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c97895-2fab-4edb-ab66-37490da43dcf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:56.174465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c97895-2fab-4edb-ab66-37490da43dcf admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:56.386321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 828/1677] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:51:56 2022] POST /identity/v3/projects => generated 365 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:56.410824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e215b4d-e0ca-44a7-bbea-bb637de6d1c5 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:56.411127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e215b4d-e0ca-44a7-bbea-bb637de6d1c5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:56.412411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e215b4d-e0ca-44a7-bbea-bb637de6d1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:56.442165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec03cc7caa944c2b7938d536b163b11'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:56.461319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec03cc7caa944c2b7938d536b163b11'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:56.462292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec03cc7caa944c2b7938d536b163b11'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:56.463098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec03cc7caa944c2b7938d536b163b11'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:56.474785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7e215b4d-e0ca-44a7-bbea-bb637de6d1c5 None None] MFA Rules not processed for user `b7ec03a4ed404a1aad608e125d4f0df8`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:56.477953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7e215b4d-e0ca-44a7-bbea-bb637de6d1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:56.587712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec03cc7caa944c2b7938d536b163b11'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:56.629284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 829/1678] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:56.633103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e215b4d-e0ca-44a7-bbea-bb637de6d1c5 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:56.633672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 850/1679] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:51:55 2022] DELETE /identity/v3/users/5ec03cc7caa944c2b7938d536b163b11 => generated 0 bytes in 722 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:56.634779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:56.635752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7e215b4d-e0ca-44a7-bbea-bb637de6d1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:56.636598 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:56.852859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e215b4d-e0ca-44a7-bbea-bb637de6d1c5 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:56.853881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3283582-08b5-4c12-a0ba-1c2a0e2c03fd admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:56.865160 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27264db0-3238-4139-8782-3303ea633bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:56.865792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27264db0-3238-4139-8782-3303ea633bde admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:56.866070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27264db0-3238-4139-8782-3303ea633bde admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:56.866344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27264db0-3238-4139-8782-3303ea633bde admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:56.866989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27264db0-3238-4139-8782-3303ea633bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:56.875313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27264db0-3238-4139-8782-3303ea633bde admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:57.026500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 851/1680] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:51:56 2022] POST /identity/v3/users => generated 289 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:51:57.027977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa5844-3fdf-4e8b-afa1-50c1e5d30ba9 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:57.028265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa5844-3fdf-4e8b-afa1-50c1e5d30ba9 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:57.028538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa5844-3fdf-4e8b-afa1-50c1e5d30ba9 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:57.031435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 852/1681] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 08:51:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:51:57.032358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa5844-3fdf-4e8b-afa1-50c1e5d30ba9 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:57.070378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbbc21-d1ba-40b7-b203-d6a9eb74d715 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:57.071025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbbc21-d1ba-40b7-b203-d6a9eb74d715 service placement] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:57.071312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbbc21-d1ba-40b7-b203-d6a9eb74d715 service placement] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:57.072282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcbbc21-d1ba-40b7-b203-d6a9eb74d715 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:57.073348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa5844-3fdf-4e8b-afa1-50c1e5d30ba9 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:57.078698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6dcbbc21-d1ba-40b7-b203-d6a9eb74d715 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:57.095233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d360386-2935-4165-b214-5c50c08f9f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:57.096229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d360386-2935-4165-b214-5c50c08f9f3a admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:57.096755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d360386-2935-4165-b214-5c50c08f9f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:57.097135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d360386-2935-4165-b214-5c50c08f9f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:57.099677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d360386-2935-4165-b214-5c50c08f9f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:57.101732 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d360386-2935-4165-b214-5c50c08f9f3a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:57.125393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbbc21-d1ba-40b7-b203-d6a9eb74d715 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:57.131753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcbbc21-d1ba-40b7-b203-d6a9eb74d715 service placement] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:57.139931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 853/1682] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:57.141329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579a57d-3a4e-4d7c-b95d-c73c2f1122d6 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:57.142071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579a57d-3a4e-4d7c-b95d-c73c2f1122d6 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:57.142449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579a57d-3a4e-4d7c-b95d-c73c2f1122d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:57.169034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 830/1683] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:57.172257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbbc21-d1ba-40b7-b203-d6a9eb74d715 service placement] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:57.201761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-e579a57d-3a4e-4d7c-b95d-c73c2f1122d6 None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:57.213701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e579a57d-3a4e-4d7c-b95d-c73c2f1122d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:57.224728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcbbc21-d1ba-40b7-b203-d6a9eb74d715 service placement] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:57.253588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab88ba5-bd8b-4df6-91c5-061d0b159354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:57.254306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab88ba5-bd8b-4df6-91c5-061d0b159354 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:57.254593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab88ba5-bd8b-4df6-91c5-061d0b159354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:57.261659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab88ba5-bd8b-4df6-91c5-061d0b159354 admin admin] PATH_INFO: `/v3/projects/4b2f66a4e22a45789ff605a5d3844a39/users/0973b9c903f942d2a4e80abaf3bfa89c/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:57.313236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab88ba5-bd8b-4df6-91c5-061d0b159354 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2f66a4e22a45789ff605a5d3844a39, user_id=0973b9c903f942d2a4e80abaf3bfa89c, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:57.317025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab88ba5-bd8b-4df6-91c5-061d0b159354 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:57.364077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:57.393702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 854/1684] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 08:51:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:57.394820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579a57d-3a4e-4d7c-b95d-c73c2f1122d6 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:57.398313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e579a57d-3a4e-4d7c-b95d-c73c2f1122d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:57.432765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579a57d-3a4e-4d7c-b95d-c73c2f1122d6 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:57.450792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:57.450792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:57.450792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:57.450792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] PATH_INFO: `/v3/users/063610aeee1341268b9efa4a3675d45d` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:57.452311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063610aeee1341268b9efa4a3675d45d)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:57.453949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 831/1685] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:57 2022] PUT /identity/v3/projects/4b2f66a4e22a45789ff605a5d3844a39/users/0973b9c903f942d2a4e80abaf3bfa89c/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:57.454862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab88ba5-bd8b-4df6-91c5-061d0b159354 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:57.461871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:57.602726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab88ba5-bd8b-4df6-91c5-061d0b159354 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:57.623297 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f18fb9-609c-45bd-9cab-d4711a491cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:57.624460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18fb9-609c-45bd-9cab-d4711a491cb3 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:57.628184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18fb9-609c-45bd-9cab-d4711a491cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:57.628184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f18fb9-609c-45bd-9cab-d4711a491cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:57.628184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c5f18fb9-609c-45bd-9cab-d4711a491cb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:57.818721 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f18fb9-609c-45bd-9cab-d4711a491cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:57.823678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f18fb9-609c-45bd-9cab-d4711a491cb3 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:57.859014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 832/1686] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:57.860726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f18fb9-609c-45bd-9cab-d4711a491cb3 service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:57.916711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063610aeee1341268b9efa4a3675d45d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:57.951379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063610aeee1341268b9efa4a3675d45d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:57.953586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063610aeee1341268b9efa4a3675d45d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:57.954236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063610aeee1341268b9efa4a3675d45d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:58.070925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f18fb9-609c-45bd-9cab-d4711a491cb3 service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:58.081478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136edef-019a-4cc7-89ba-76268e96f452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:58.082162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136edef-019a-4cc7-89ba-76268e96f452 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:58.082446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136edef-019a-4cc7-89ba-76268e96f452 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:58.082720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9136edef-019a-4cc7-89ba-76268e96f452 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:58.083462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136edef-019a-4cc7-89ba-76268e96f452 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:58.085072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9136edef-019a-4cc7-89ba-76268e96f452 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:58.104684 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:58.123956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 833/1687] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:51:58.123956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136edef-019a-4cc7-89ba-76268e96f452 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:58.125289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9136edef-019a-4cc7-89ba-76268e96f452 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:58.141621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9136edef-019a-4cc7-89ba-76268e96f452 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:58.149816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea121c-9822-47e2-8fea-7f62e1572676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:58.151076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea121c-9822-47e2-8fea-7f62e1572676 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:58.151427 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea121c-9822-47e2-8fea-7f62e1572676 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:58.151781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea121c-9822-47e2-8fea-7f62e1572676 admin admin] PATH_INFO: `/v3/projects/4b2f66a4e22a45789ff605a5d3844a39/users/0973b9c903f942d2a4e80abaf3bfa89c/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:58.162069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea121c-9822-47e2-8fea-7f62e1572676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2f66a4e22a45789ff605a5d3844a39, user_id=0973b9c903f942d2a4e80abaf3bfa89c, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:58.166892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063610aeee1341268b9efa4a3675d45d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:58.212381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ea121c-9822-47e2-8fea-7f62e1572676 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:58.273948 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 855/1688] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:51:57 2022] DELETE /identity/v3/users/063610aeee1341268b9efa4a3675d45d => generated 0 bytes in 880 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:58.283787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:58.294178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:58.295259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 834/1689] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:51:58 2022] PUT /identity/v3/projects/4b2f66a4e22a45789ff605a5d3844a39/users/0973b9c903f942d2a4e80abaf3bfa89c/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:51:58.307017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83e422-ee1d-476e-9a35-e50e4248f796 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:58.307326 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83e422-ee1d-476e-9a35-e50e4248f796 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:58.309078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf83e422-ee1d-476e-9a35-e50e4248f796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:58.438313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bf83e422-ee1d-476e-9a35-e50e4248f796 None None] MFA Rules not processed for user `0973b9c903f942d2a4e80abaf3bfa89c`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:58.439908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bf83e422-ee1d-476e-9a35-e50e4248f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:58.533480 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92baa8-3b92-4230-a6dc-ab13ec43c635 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:58.548381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:58.550720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:58.558224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:58.558224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] PATH_INFO: `/v3/projects/a26b19e59c1e48adb80052627d3394b5` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:58.558224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a26b19e59c1e48adb80052627d3394b5)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:58.561649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:58.680937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 835/1690] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:58.682329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c36c7d-1b11-4d39-9c3d-5d9edbfe03a7 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:58.682621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c36c7d-1b11-4d39-9c3d-5d9edbfe03a7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:58.682907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c36c7d-1b11-4d39-9c3d-5d9edbfe03a7 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:58.693017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 836/1691] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 4 08:51:58 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:51:58.696757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e282fac-6b16-454b-8b21-cb5f556fb72a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:58.697078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e282fac-6b16-454b-8b21-cb5f556fb72a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:58.697328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e282fac-6b16-454b-8b21-cb5f556fb72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:58.749955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-6e282fac-6b16-454b-8b21-cb5f556fb72a None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:58.751231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6e282fac-6b16-454b-8b21-cb5f556fb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:58.894007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a26b19e59c1e48adb80052627d3394b5', 'request_id': 'req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:58.931669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 837/1692] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:51:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:58.932598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e282fac-6b16-454b-8b21-cb5f556fb72a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:58.934621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6e282fac-6b16-454b-8b21-cb5f556fb72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:59.003069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e282fac-6b16-454b-8b21-cb5f556fb72a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:59.029695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a26b19e59c1e48adb80052627d3394b5', 'request_id': 'req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:59.039685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a26b19e59c1e48adb80052627d3394b5', 'request_id': 'req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:59.064298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] The token cache is being invalidate because project a26b19e59c1e48adb80052627d3394b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:51:59.064420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:59.065056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:59.068045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 856/1693] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:51:58 2022] DELETE /identity/v3/projects/a26b19e59c1e48adb80052627d3394b5 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:59.068622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:59.073671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:59.114450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:59.115686 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:59.116131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:59.116716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:59.124323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:59.184267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:51:59.235574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:59.237439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:59.251817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 838/1694] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:59.251817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:59.253749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:59.272174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac805a-5e7a-446c-bf03-ba491c5c9f6b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:59.285708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:59.286678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:59.288566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:59.289053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] PATH_INFO: `/v3/users/f799878bf93746b9b8e39539bb95ed36` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:59.292816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f799878bf93746b9b8e39539bb95ed36)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:59.298244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:59.410256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c88bfb1-c4f0-4c49-b6d8-6b70884f10d3 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:59.415261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53633c-da9d-4240-889f-fb555bcb6733 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:59.416053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53633c-da9d-4240-889f-fb555bcb6733 service glance] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:59.416568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53633c-da9d-4240-889f-fb555bcb6733 service glance] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:59.417028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53633c-da9d-4240-889f-fb555bcb6733 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:59.419890 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8d53633c-da9d-4240-889f-fb555bcb6733 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:59.556107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53633c-da9d-4240-889f-fb555bcb6733 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:59.557992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53633c-da9d-4240-889f-fb555bcb6733 service glance] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:59.570849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f799878bf93746b9b8e39539bb95ed36'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:59.592967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 839/1695] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:51:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:51:59.596950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86b61-d10a-4873-b43f-6f75b41ed02a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:59.596950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86b61-d10a-4873-b43f-6f75b41ed02a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:59.597224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f799878bf93746b9b8e39539bb95ed36'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:59.597307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a86b61-d10a-4873-b43f-6f75b41ed02a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:59.597379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f799878bf93746b9b8e39539bb95ed36'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:59.597379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f799878bf93746b9b8e39539bb95ed36'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:59.637423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b4a86b61-d10a-4873-b43f-6f75b41ed02a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:59.637423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b4a86b61-d10a-4873-b43f-6f75b41ed02a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:59.658285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 840/1696] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:59.660815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0485aa-c779-4407-8865-7178bcce25ff None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:59.661293 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0485aa-c779-4407-8865-7178bcce25ff None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:59.661765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0485aa-c779-4407-8865-7178bcce25ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:59.700603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f799878bf93746b9b8e39539bb95ed36'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:51:59.721930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-eb0485aa-c779-4407-8865-7178bcce25ff None None] MFA Rules not processed for user `2d5f07704f014ae7a4997fca3c2faa6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:59.726534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-eb0485aa-c779-4407-8865-7178bcce25ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:59.743103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 857/1697] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:51:59 2022] DELETE /identity/v3/users/f799878bf93746b9b8e39539bb95ed36 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:51:59.743922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:51:59.747985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:51:59.899204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 841/1698] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:51:59.900757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01109198-b689-4bcb-b5ac-8e0e22a4dee1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:51:59.901492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70d0cf-2518-4fed-b03d-f25778a6d369 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:59.901832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70d0cf-2518-4fed-b03d-f25778a6d369 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:59.902110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db70d0cf-2518-4fed-b03d-f25778a6d369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:59.919546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:51:59.920330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:51:59.920657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:51:59.921009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] PATH_INFO: `/v3/projects/f10b2f7a461849a48f16e7f5a0b39881` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:51:59.923895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f10b2f7a461849a48f16e7f5a0b39881)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:51:59.927435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:51:59.966968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-db70d0cf-2518-4fed-b03d-f25778a6d369 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:51:59.969276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-db70d0cf-2518-4fed-b03d-f25778a6d369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.016933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 842/1699] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:51:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:00.023053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e9830-ab1b-4318-8986-9608c2c85ef0 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:00.024858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e9830-ab1b-4318-8986-9608c2c85ef0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:00.024858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e9830-ab1b-4318-8986-9608c2c85ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:00.068473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9f3e9830-ab1b-4318-8986-9608c2c85ef0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:00.069698 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9f3e9830-ab1b-4318-8986-9608c2c85ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.089695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 843/1700] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:00.091924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4bd00-fe79-4629-8c4a-9efc2ca8342b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:00.092879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4bd00-fe79-4629-8c4a-9efc2ca8342b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:00.092879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4bd00-fe79-4629-8c4a-9efc2ca8342b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:00.122875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-18e4bd00-fe79-4629-8c4a-9efc2ca8342b None None] MFA Rules not processed for user `2d5f07704f014ae7a4997fca3c2faa6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:00.123865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-18e4bd00-fe79-4629-8c4a-9efc2ca8342b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.180492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f10b2f7a461849a48f16e7f5a0b39881', 'request_id': 'req-043c3bec-c30a-47d0-b956-617761ac3e8d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:00.197699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 844/1701] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:00 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:00.198355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4bd00-fe79-4629-8c4a-9efc2ca8342b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:00.217538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4bd00-fe79-4629-8c4a-9efc2ca8342b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:00.292862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f10b2f7a461849a48f16e7f5a0b39881', 'request_id': 'req-043c3bec-c30a-47d0-b956-617761ac3e8d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:00.303075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f10b2f7a461849a48f16e7f5a0b39881', 'request_id': 'req-043c3bec-c30a-47d0-b956-617761ac3e8d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:00.306105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81590d1-329b-4615-93e7-daaefc0cbbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:00.307039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81590d1-329b-4615-93e7-daaefc0cbbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:00.307613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81590d1-329b-4615-93e7-daaefc0cbbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:00.308174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81590d1-329b-4615-93e7-daaefc0cbbc7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:00.326163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81590d1-329b-4615-93e7-daaefc0cbbc7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:00.328582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81590d1-329b-4615-93e7-daaefc0cbbc7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:00.340389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81590d1-329b-4615-93e7-daaefc0cbbc7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:00.358507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] The token cache is being invalidate because project f10b2f7a461849a48f16e7f5a0b39881 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:00.360413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:00.371839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:00.379205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 858/1702] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:51:59 2022] DELETE /identity/v3/projects/f10b2f7a461849a48f16e7f5a0b39881 => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:00.379205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:00.387710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.390959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 845/1703] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:00.393979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509a95-a73b-482b-8af1-ad52bdded4d6 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:00.394336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509a95-a73b-482b-8af1-ad52bdded4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:00.394534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa509a95-a73b-482b-8af1-ad52bdded4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:00.469259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-fa509a95-a73b-482b-8af1-ad52bdded4d6 None None] MFA Rules not processed for user `b9aef63cad18473994760d8bbc6faae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:00.471379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fa509a95-a73b-482b-8af1-ad52bdded4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.526192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043c3bec-c30a-47d0-b956-617761ac3e8d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:00.534668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:00.536912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:00.537193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:00.537467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:00.542207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.575196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:00.575196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:00.598426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 859/1704] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:00.604339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:00.608751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.633209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 846/1705] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:00.634128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509a95-a73b-482b-8af1-ad52bdded4d6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:00.635552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fa509a95-a73b-482b-8af1-ad52bdded4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.670696 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa509a95-a73b-482b-8af1-ad52bdded4d6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:00.682632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:00.684952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:00.686960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:00.689033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] PATH_INFO: `/v3/users/3f79408c57ac4ccfa4cb609137ba9122` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:00.698445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f79408c57ac4ccfa4cb609137ba9122)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:00.702258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:00.791447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d109dbe-6b1c-4f01-a1bf-6b43a840601b service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:00.799969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:00.827268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:00.827268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:00.827268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:00.827268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.898826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:00.900740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:00.912992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 860/1706] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:00.919350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:00.919350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:00.936551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcdc1be-4cec-4e9b-b911-a46866976e22 service nova] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:00.941718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7d5eed-5949-464a-80cd-de5d81cc376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:00.943223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5eed-5949-464a-80cd-de5d81cc376d admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:00.943499 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5eed-5949-464a-80cd-de5d81cc376d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:00.944170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7d5eed-5949-464a-80cd-de5d81cc376d admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:00.945021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d5eed-5949-464a-80cd-de5d81cc376d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:00.951787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7d5eed-5949-464a-80cd-de5d81cc376d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:01.046219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f79408c57ac4ccfa4cb609137ba9122'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.054066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f79408c57ac4ccfa4cb609137ba9122'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.054787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f79408c57ac4ccfa4cb609137ba9122'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.055972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f79408c57ac4ccfa4cb609137ba9122'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.068392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 861/1707] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:00 2022] POST /identity/v3/projects => generated 407 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:01.070083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740536c5-f13c-490d-a2f5-f5aed1d02426 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:01.072260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740536c5-f13c-490d-a2f5-f5aed1d02426 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:01.072260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740536c5-f13c-490d-a2f5-f5aed1d02426 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:01.079884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 862/1708] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 4 08:52:01 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:52:01.081197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740536c5-f13c-490d-a2f5-f5aed1d02426 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:01.083158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-740536c5-f13c-490d-a2f5-f5aed1d02426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:01.178136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-31c9054e-c9fd-43e0-a8ad-9a9858ee26cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f79408c57ac4ccfa4cb609137ba9122'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.193048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740536c5-f13c-490d-a2f5-f5aed1d02426 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:01.216874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 847/1709] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:00 2022] DELETE /identity/v3/users/3f79408c57ac4ccfa4cb609137ba9122 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:01.225337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fcd13-4135-4e90-83a9-e9bdbefb6b85 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:01.227106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:01.228121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fcd13-4135-4e90-83a9-e9bdbefb6b85 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:01.228583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72fcd13-4135-4e90-83a9-e9bdbefb6b85 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:01.234262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:01.234616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:01.235383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] PATH_INFO: `/v3/users/8b3634a49783446dbf436da8e80e2df5` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:01.236175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 848/1710] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 4 08:52:01 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:52:01.237058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fcd13-4135-4e90-83a9-e9bdbefb6b85 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:01.239429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3634a49783446dbf436da8e80e2df5)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:01.241502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:01.244422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a72fcd13-4135-4e90-83a9-e9bdbefb6b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:01.408661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72fcd13-4135-4e90-83a9-e9bdbefb6b85 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:01.415951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6b4f2-7d23-4fcf-bcb5-aed23ec150ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:01.420847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6b4f2-7d23-4fcf-bcb5-aed23ec150ba admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:01.420847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6b4f2-7d23-4fcf-bcb5-aed23ec150ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:01.420847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6b4f2-7d23-4fcf-bcb5-aed23ec150ba admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:01.420847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6b4f2-7d23-4fcf-bcb5-aed23ec150ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:01.420847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6b4f2-7d23-4fcf-bcb5-aed23ec150ba admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:01.565242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 849/1711] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:01 2022] POST /identity/v3/users => generated 304 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:01.566803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb8229-3b59-4f60-9199-8ea59fc406ed None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:01.567265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb8229-3b59-4f60-9199-8ea59fc406ed None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:01.567730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eb8229-3b59-4f60-9199-8ea59fc406ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:01.577461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3634a49783446dbf436da8e80e2df5'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.597034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3634a49783446dbf436da8e80e2df5'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.598334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3634a49783446dbf436da8e80e2df5'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.599146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3634a49783446dbf436da8e80e2df5'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.697136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-76eb8229-3b59-4f60-9199-8ea59fc406ed None None] MFA Rules not processed for user `a269743c34bc48edaab5c0e3e78074c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:01.698554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-76eb8229-3b59-4f60-9199-8ea59fc406ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:01.738631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-601df0d1-dd37-433c-8fcd-b09929112126 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3634a49783446dbf436da8e80e2df5'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:01.777076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 863/1712] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:01 2022] DELETE /identity/v3/users/8b3634a49783446dbf436da8e80e2df5 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:01.778946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a4ea6-8c90-4882-97e4-8af8aa4c73b7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:01.779243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a4ea6-8c90-4882-97e4-8af8aa4c73b7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:01.781236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a4ea6-8c90-4882-97e4-8af8aa4c73b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:01.797421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 850/1713] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:52:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:01.798740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb8229-3b59-4f60-9199-8ea59fc406ed None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:01.800751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-76eb8229-3b59-4f60-9199-8ea59fc406ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:01.828732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eb8229-3b59-4f60-9199-8ea59fc406ed None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:01.830541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-6b6a4ea6-8c90-4882-97e4-8af8aa4c73b7 None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:01.832919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6b6a4ea6-8c90-4882-97e4-8af8aa4c73b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:01.913049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:01.913758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:01.914329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:01.914634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] PATH_INFO: `/v3/projects/0c3ab9b85f5a4ef6bf397ad393b4ba6a` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:01.915916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c3ab9b85f5a4ef6bf397ad393b4ba6a)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:01.919084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:01.927951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:01.943928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 864/1714] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:52:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:01.952429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a4ea6-8c90-4882-97e4-8af8aa4c73b7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:01.955965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6b6a4ea6-8c90-4882-97e4-8af8aa4c73b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:01.973067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a4ea6-8c90-4882-97e4-8af8aa4c73b7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:01.978292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc735b-a81f-45ea-b5cb-ea276a1e20e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:01.978904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc735b-a81f-45ea-b5cb-ea276a1e20e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:01.979731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc735b-a81f-45ea-b5cb-ea276a1e20e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:01.979731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc735b-a81f-45ea-b5cb-ea276a1e20e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:01.980132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc735b-a81f-45ea-b5cb-ea276a1e20e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:01.982330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc735b-a81f-45ea-b5cb-ea276a1e20e8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:01.996437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 865/1715] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:01.996437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc735b-a81f-45ea-b5cb-ea276a1e20e8 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:01.998468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-75bc735b-a81f-45ea-b5cb-ea276a1e20e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.012034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc735b-a81f-45ea-b5cb-ea276a1e20e8 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:02.016619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:02.017275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.017555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.017894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] PATH_INFO: `/v3/projects/68cf552ee9724bfd97c612d66111fde7` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.019004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] RBAC: Authorizing `identity:delete_project(project_id=68cf552ee9724bfd97c612d66111fde7)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:02.020950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:02.102183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c3ab9b85f5a4ef6bf397ad393b4ba6a', 'request_id': 'req-b4e3f061-7f53-429d-aedf-8187018c3761'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.216747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68cf552ee9724bfd97c612d66111fde7', 'request_id': 'req-5ff9e675-73e9-4790-aa5a-e320f339189a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.233118 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c3ab9b85f5a4ef6bf397ad393b4ba6a', 'request_id': 'req-b4e3f061-7f53-429d-aedf-8187018c3761'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.240706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c3ab9b85f5a4ef6bf397ad393b4ba6a', 'request_id': 'req-b4e3f061-7f53-429d-aedf-8187018c3761'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.253062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] The token cache is being invalidate because project 0c3ab9b85f5a4ef6bf397ad393b4ba6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:02.253419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.254125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-b4e3f061-7f53-429d-aedf-8187018c3761 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.257016 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 851/1716] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:01 2022] DELETE /identity/v3/projects/0c3ab9b85f5a4ef6bf397ad393b4ba6a => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:02.257681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35bc81-9083-4a37-b8aa-1b2b2c8b3064 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.257970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35bc81-9083-4a37-b8aa-1b2b2c8b3064 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.258251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35bc81-9083-4a37-b8aa-1b2b2c8b3064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.284081 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1a35bc81-9083-4a37-b8aa-1b2b2c8b3064 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:02.285816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1a35bc81-9083-4a37-b8aa-1b2b2c8b3064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.319154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68cf552ee9724bfd97c612d66111fde7', 'request_id': 'req-5ff9e675-73e9-4790-aa5a-e320f339189a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.332057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68cf552ee9724bfd97c612d66111fde7', 'request_id': 'req-5ff9e675-73e9-4790-aa5a-e320f339189a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.349209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] The token cache is being invalidate because project 68cf552ee9724bfd97c612d66111fde7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:02.350314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.353350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:02.357142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 866/1717] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:01 2022] DELETE /identity/v3/projects/68cf552ee9724bfd97c612d66111fde7 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:02.358512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:02.361901 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.379343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 852/1718] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:02.380515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35bc81-9083-4a37-b8aa-1b2b2c8b3064 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:02.381824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1a35bc81-9083-4a37-b8aa-1b2b2c8b3064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.459185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:02.485469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9e675-73e9-4790-aa5a-e320f339189a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:02.489122 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a35bc81-9083-4a37-b8aa-1b2b2c8b3064 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:02.495037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:02.500703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:02.500841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.500841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.500973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.501059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.501128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.501128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.501244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.511811 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.533008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:02.534564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:02.563216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 867/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:02.563935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:02.569597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.586929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d026c0-e18c-40c4-97f5-3e3c10b3226e service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:02.600366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a841571-fd1e-44d5-a529-baae8ddc50fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:02.600560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a841571-fd1e-44d5-a529-baae8ddc50fb admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.600765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a841571-fd1e-44d5-a529-baae8ddc50fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.601041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a841571-fd1e-44d5-a529-baae8ddc50fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.601688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a841571-fd1e-44d5-a529-baae8ddc50fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:02.604053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a841571-fd1e-44d5-a529-baae8ddc50fb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:02.621024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:02.622376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:02.627032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 868/1720] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:02.628185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c061d9-c577-4482-9be4-488b703d8d44 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.628475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c061d9-c577-4482-9be4-488b703d8d44 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.629265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c061d9-c577-4482-9be4-488b703d8d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.655532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 853/1721] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:02.656611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:02.660695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.676717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-86c061d9-c577-4482-9be4-488b703d8d44 None None] MFA Rules not processed for user `35b0d1ed01c344acb96ab00c7c163e18`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:02.677953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-86c061d9-c577-4482-9be4-488b703d8d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.727055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72907e4d-ee24-467d-9e56-a13ddf00fe1a service glance] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:02.737370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:02.738141 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.739401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.739816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] PATH_INFO: `/v3/users/23f9c6b63b2a42418d2ed60647536653` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.742057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f9c6b63b2a42418d2ed60647536653)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:02.745054 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:02.793913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 869/1722] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:02.807179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef43db-8a45-4d91-b7c8-646bf9f77d48 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.807179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef43db-8a45-4d91-b7c8-646bf9f77d48 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.807179 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef43db-8a45-4d91-b7c8-646bf9f77d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.820834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-e1ef43db-8a45-4d91-b7c8-646bf9f77d48 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:02.822974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e1ef43db-8a45-4d91-b7c8-646bf9f77d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.834136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 870/1723] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:02.834826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef43db-8a45-4d91-b7c8-646bf9f77d48 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:02.836927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e1ef43db-8a45-4d91-b7c8-646bf9f77d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:02.849485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef43db-8a45-4d91-b7c8-646bf9f77d48 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:02.855489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed81a0d-9794-463a-b3ef-73eb4a711d21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:02.856413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81a0d-9794-463a-b3ef-73eb4a711d21 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.856711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81a0d-9794-463a-b3ef-73eb4a711d21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.858726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed81a0d-9794-463a-b3ef-73eb4a711d21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.877912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed81a0d-9794-463a-b3ef-73eb4a711d21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:02.885066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed81a0d-9794-463a-b3ef-73eb4a711d21 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:02.906463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 871/1724] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:02.907375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed81a0d-9794-463a-b3ef-73eb4a711d21 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:02.933613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed81a0d-9794-463a-b3ef-73eb4a711d21 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:02.942095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50ef8b-9cf0-42f8-8365-9d3806bdffa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:02.942777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50ef8b-9cf0-42f8-8365-9d3806bdffa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:02.943054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50ef8b-9cf0-42f8-8365-9d3806bdffa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:02.943327 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50ef8b-9cf0-42f8-8365-9d3806bdffa6 admin admin] PATH_INFO: `/v3/projects/e409e51649fc47a890a9797e0f676df4/users/530335ffd42e461ca5c809c261dedcf3/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:02.968503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50ef8b-9cf0-42f8-8365-9d3806bdffa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e409e51649fc47a890a9797e0f676df4, user_id=530335ffd42e461ca5c809c261dedcf3, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:02.973649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50ef8b-9cf0-42f8-8365-9d3806bdffa6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:02.983709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f9c6b63b2a42418d2ed60647536653'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:03.000664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f9c6b63b2a42418d2ed60647536653'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:03.001640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f9c6b63b2a42418d2ed60647536653'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:03.004231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f9c6b63b2a42418d2ed60647536653'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:03.134460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 872/1725] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:02 2022] PUT /identity/v3/projects/e409e51649fc47a890a9797e0f676df4/users/530335ffd42e461ca5c809c261dedcf3/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:03.136173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c7333-9203-467c-be08-9b3ebf61ee59 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:03.136604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c7333-9203-467c-be08-9b3ebf61ee59 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:03.137044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07c7333-9203-467c-be08-9b3ebf61ee59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:03.158926 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f07c7333-9203-467c-be08-9b3ebf61ee59 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:03.160853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9017392e-8995-468b-9cf3-b1d76d01b782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f9c6b63b2a42418d2ed60647536653'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:03.161857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f07c7333-9203-467c-be08-9b3ebf61ee59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:03.217652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 854/1726] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:02 2022] DELETE /identity/v3/users/23f9c6b63b2a42418d2ed60647536653 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:03.221823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281bc3c-3b81-4c37-9f81-11decbdb21a7 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:03.223377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281bc3c-3b81-4c37-9f81-11decbdb21a7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:03.223864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281bc3c-3b81-4c37-9f81-11decbdb21a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:03.236134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 873/1727] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:03.240011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c7333-9203-467c-be08-9b3ebf61ee59 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:03.252137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07c7333-9203-467c-be08-9b3ebf61ee59 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:03.292876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-3281bc3c-3b81-4c37-9f81-11decbdb21a7 None None] MFA Rules not processed for user `530335ffd42e461ca5c809c261dedcf3`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:03.294432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3281bc3c-3b81-4c37-9f81-11decbdb21a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:03.388785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:03.389505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:03.389779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:03.390175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:03.390986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:03.393570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:03.397497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:03.434422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 874/1728] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:03.435306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:03.438175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:03.477480 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 855/1729] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:03 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:03.478961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460b1e-2f42-4439-a728-49f7ad0c60cf None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:03.479558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460b1e-2f42-4439-a728-49f7ad0c60cf None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:03.480430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5460b1e-2f42-4439-a728-49f7ad0c60cf None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:03.483019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 856/1730] 10.222.0.25 () {54 vars in 912 bytes} [Tue Oct 4 08:52:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:52:03.484037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5460b1e-2f42-4439-a728-49f7ad0c60cf None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:03.488495 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:03.503402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5460b1e-2f42-4439-a728-49f7ad0c60cf None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:03.508942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bb27e-e029-4e77-9f87-a951a1cb24d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:03.509893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bb27e-e029-4e77-9f87-a951a1cb24d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:03.510291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bb27e-e029-4e77-9f87-a951a1cb24d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:03.510683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bb27e-e029-4e77-9f87-a951a1cb24d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:03.511395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bb27e-e029-4e77-9f87-a951a1cb24d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:03.519413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9bb27e-e029-4e77-9f87-a951a1cb24d2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:03.554299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d5b3f-3fe6-4cbc-a603-e6972171479a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:03.562206 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:03.563169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:03.563673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:03.564301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:03.567440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:03.702977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:03.703686 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 857/1731] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:03 2022] POST /identity/v3/projects => generated 373 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:03.705553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:03.707785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bb27e-e029-4e77-9f87-a951a1cb24d2 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:03.712530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cd9bb27e-e029-4e77-9f87-a951a1cb24d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:03.744035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 875/1732] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:03.744961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:03.750195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:03.789051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb57430-cdb4-44fb-b75a-5d44c2880677 service nova] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:03.837390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9bb27e-e029-4e77-9f87-a951a1cb24d2 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:03.851822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10996839-3dfb-4ae0-877d-26eeb59ae9c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:03.857510 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10996839-3dfb-4ae0-877d-26eeb59ae9c2 service placement] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:03.857510 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10996839-3dfb-4ae0-877d-26eeb59ae9c2 service placement] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:03.857510 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10996839-3dfb-4ae0-877d-26eeb59ae9c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:03.869809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-10996839-3dfb-4ae0-877d-26eeb59ae9c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:03.925138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10996839-3dfb-4ae0-877d-26eeb59ae9c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:03.936605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10996839-3dfb-4ae0-877d-26eeb59ae9c2 service placement] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:03.997207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 858/1733] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:03.998850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52e57a-4769-4e8a-bb4c-119e3d66aa2a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:03.999134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52e57a-4769-4e8a-bb4c-119e3d66aa2a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:03.999781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f52e57a-4769-4e8a-bb4c-119e3d66aa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:04.036407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb559-6d75-41cb-87de-1269c335273a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:04.038975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb559-6d75-41cb-87de-1269c335273a admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:04.039432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb559-6d75-41cb-87de-1269c335273a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:04.039789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb559-6d75-41cb-87de-1269c335273a admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:04.041446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb559-6d75-41cb-87de-1269c335273a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:04.049262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7f52e57a-4769-4e8a-bb4c-119e3d66aa2a None None] MFA Rules not processed for user `a269743c34bc48edaab5c0e3e78074c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:04.050533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7f52e57a-4769-4e8a-bb4c-119e3d66aa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:04.061158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb559-6d75-41cb-87de-1269c335273a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:04.147730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 859/1734] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:52:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:04.148946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52e57a-4769-4e8a-bb4c-119e3d66aa2a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:04.171371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f52e57a-4769-4e8a-bb4c-119e3d66aa2a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:04.180217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ea561-c6e9-470e-9270-b95e837508cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:04.180877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ea561-c6e9-470e-9270-b95e837508cf admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:04.181157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ea561-c6e9-470e-9270-b95e837508cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:04.186642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ea561-c6e9-470e-9270-b95e837508cf admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:04.186642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ea561-c6e9-470e-9270-b95e837508cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:04.186642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ea561-c6e9-470e-9270-b95e837508cf admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:04.242049 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 876/1735] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:03 2022] POST /identity/v3/projects => generated 409 bytes in 498 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:04.244530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb559-6d75-41cb-87de-1269c335273a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:04.250067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-67dcb559-6d75-41cb-87de-1269c335273a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:04.307813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 860/1736] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:04 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:04.308709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ea561-c6e9-470e-9270-b95e837508cf admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:04.315210 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-625ea561-c6e9-470e-9270-b95e837508cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:04.338343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ea561-c6e9-470e-9270-b95e837508cf admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:04.430695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb559-6d75-41cb-87de-1269c335273a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:04.440148 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:04.440827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:04.441692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:04.441692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] PATH_INFO: `/v3/projects/65a9e93116b94fceb6014159f0e5c7c5` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:04.444255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65a9e93116b94fceb6014159f0e5c7c5)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:04.446292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:04.471677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:04.472582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:04.473026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:04.473449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] PATH_INFO: `/v3/projects/b316ad86a2d0422b8316e2ca3711cfde` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:04.475465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b316ad86a2d0422b8316e2ca3711cfde)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:04.477839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:04.655906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65a9e93116b94fceb6014159f0e5c7c5', 'request_id': 'req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.690294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:04.730334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b316ad86a2d0422b8316e2ca3711cfde', 'request_id': 'req-f478814a-bb9b-4153-aa67-0b7f07421184'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.747085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65a9e93116b94fceb6014159f0e5c7c5', 'request_id': 'req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.757474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65a9e93116b94fceb6014159f0e5c7c5', 'request_id': 'req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.794755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] The token cache is being invalidate because project 65a9e93116b94fceb6014159f0e5c7c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:04.795062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.796005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.800393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 877/1737] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:04 2022] DELETE /identity/v3/projects/65a9e93116b94fceb6014159f0e5c7c5 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:04.801282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:04.815443 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:04.857451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b316ad86a2d0422b8316e2ca3711cfde', 'request_id': 'req-f478814a-bb9b-4153-aa67-0b7f07421184'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.857930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b316ad86a2d0422b8316e2ca3711cfde', 'request_id': 'req-f478814a-bb9b-4153-aa67-0b7f07421184'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.904566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] The token cache is being invalidate because project b316ad86a2d0422b8316e2ca3711cfde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:04.904894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.906922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:04.913671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 861/1738] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:04 2022] DELETE /identity/v3/projects/b316ad86a2d0422b8316e2ca3711cfde => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:04.913671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:04.916443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:05.014135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd3c09-3988-4cbe-84a8-a61af25d5a01 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:05.082401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f478814a-bb9b-4153-aa67-0b7f07421184 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:05.088237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c959aa3-8ee6-4b9f-9b62-9b758c5a81d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:05.088940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c959aa3-8ee6-4b9f-9b62-9b758c5a81d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.089300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c959aa3-8ee6-4b9f-9b62-9b758c5a81d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.089649 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c959aa3-8ee6-4b9f-9b62-9b758c5a81d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.090555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c959aa3-8ee6-4b9f-9b62-9b758c5a81d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:05.094011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c959aa3-8ee6-4b9f-9b62-9b758c5a81d5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:05.103176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:05.103900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.104181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.114313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.114313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:05.119409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:05.120967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:05.132224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 878/1739] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:05.133605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:05.137180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:05.164733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3fe332-4b6d-41c9-bc8e-ad723a9a8be5 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:05.203005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d798d-5ec1-4b21-aa24-44b4baa2e754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:05.203851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d798d-5ec1-4b21-aa24-44b4baa2e754 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.204143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d798d-5ec1-4b21-aa24-44b4baa2e754 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.204419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d798d-5ec1-4b21-aa24-44b4baa2e754 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.235833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d798d-5ec1-4b21-aa24-44b4baa2e754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:05.240415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 862/1740] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:04 2022] POST /identity/v3/users => generated 311 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:05.240415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9ce1-8245-4435-b6ec-70cf41e658b0 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.240415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9ce1-8245-4435-b6ec-70cf41e658b0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.241080 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5d798d-5ec1-4b21-aa24-44b4baa2e754 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:05.241152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969d9ce1-8245-4435-b6ec-70cf41e658b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.274711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-969d9ce1-8245-4435-b6ec-70cf41e658b0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:05.276021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-969d9ce1-8245-4435-b6ec-70cf41e658b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:05.288225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 879/1741] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:05.290133 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d798d-5ec1-4b21-aa24-44b4baa2e754 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:05.293842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-af5d798d-5ec1-4b21-aa24-44b4baa2e754 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:05.293974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:05.297376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 863/1742] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:05.300393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d9ce1-8245-4435-b6ec-70cf41e658b0 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:05.345708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969d9ce1-8245-4435-b6ec-70cf41e658b0 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:05.351139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d798d-5ec1-4b21-aa24-44b4baa2e754 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:05.372216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:05.380321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.381201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.381691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] PATH_INFO: `/v3/users/0973b9c903f942d2a4e80abaf3bfa89c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.388807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0973b9c903f942d2a4e80abaf3bfa89c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:05.395943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45b015-155e-4dfc-94ed-56bf6b73fc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:05.396600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45b015-155e-4dfc-94ed-56bf6b73fc9c admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.397376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45b015-155e-4dfc-94ed-56bf6b73fc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.397376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db45b015-155e-4dfc-94ed-56bf6b73fc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.399749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45b015-155e-4dfc-94ed-56bf6b73fc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:05.400078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:05.401510 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db45b015-155e-4dfc-94ed-56bf6b73fc9c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:05.436180 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 864/1743] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:05.437475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45b015-155e-4dfc-94ed-56bf6b73fc9c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:05.458366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db45b015-155e-4dfc-94ed-56bf6b73fc9c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:05.464369 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a7aec-912d-4327-81a9-039615a93d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:05.467188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a7aec-912d-4327-81a9-039615a93d33 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.467805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a7aec-912d-4327-81a9-039615a93d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.468382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a7aec-912d-4327-81a9-039615a93d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.469273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a7aec-912d-4327-81a9-039615a93d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:05.471977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a7aec-912d-4327-81a9-039615a93d33 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:05.497183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 865/1744] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:05.499376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc53be3-81bc-44e3-b64b-2b4f746911c6 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.499706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc53be3-81bc-44e3-b64b-2b4f746911c6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.499988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc53be3-81bc-44e3-b64b-2b4f746911c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.539482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-3cc53be3-81bc-44e3-b64b-2b4f746911c6 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:05.540846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3cc53be3-81bc-44e3-b64b-2b4f746911c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:05.550767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 866/1745] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:05.552058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc53be3-81bc-44e3-b64b-2b4f746911c6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:05.563089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc53be3-81bc-44e3-b64b-2b4f746911c6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:05.568224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3b18-776b-498e-9759-4f6d94a8ecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:05.569808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3b18-776b-498e-9759-4f6d94a8ecd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.570093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3b18-776b-498e-9759-4f6d94a8ecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.570373 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d3b18-776b-498e-9759-4f6d94a8ecd8 admin admin] PATH_INFO: `/v3/projects/60035531dcf84000af63df0afd0a6b23/users/262a39c3483a4ce5bb2d17da8b8cad79/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.612451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d3b18-776b-498e-9759-4f6d94a8ecd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60035531dcf84000af63df0afd0a6b23, user_id=262a39c3483a4ce5bb2d17da8b8cad79, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:05.616070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d3b18-776b-498e-9759-4f6d94a8ecd8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:05.755649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0973b9c903f942d2a4e80abaf3bfa89c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:05.764170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 867/1746] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:05 2022] PUT /identity/v3/projects/60035531dcf84000af63df0afd0a6b23/users/262a39c3483a4ce5bb2d17da8b8cad79/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:05.766135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3b18-776b-498e-9759-4f6d94a8ecd8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:05.776547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0973b9c903f942d2a4e80abaf3bfa89c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:05.778842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0973b9c903f942d2a4e80abaf3bfa89c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:05.782308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0973b9c903f942d2a4e80abaf3bfa89c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:05.926736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0973b9c903f942d2a4e80abaf3bfa89c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:05.930956 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d3b18-776b-498e-9759-4f6d94a8ecd8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:05.936874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be655c-ac17-4064-999c-f93bcd26908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:05.937679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be655c-ac17-4064-999c-f93bcd26908c admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:05.938018 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be655c-ac17-4064-999c-f93bcd26908c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:05.939076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58be655c-ac17-4064-999c-f93bcd26908c admin admin] PATH_INFO: `/v3/projects/1a61d543b73c4768ba6ba5de593162ca/users/529b916707e54aceb2f324a0d1a7f138/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:05.959653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be655c-ac17-4064-999c-f93bcd26908c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a61d543b73c4768ba6ba5de593162ca, user_id=529b916707e54aceb2f324a0d1a7f138, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:05.962833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58be655c-ac17-4064-999c-f93bcd26908c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:05.983861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 880/1747] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:05 2022] DELETE /identity/v3/users/0973b9c903f942d2a4e80abaf3bfa89c => generated 0 bytes in 695 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:05.988041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:05.989983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:06.118749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 868/1748] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:05 2022] PUT /identity/v3/projects/1a61d543b73c4768ba6ba5de593162ca/users/529b916707e54aceb2f324a0d1a7f138/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:06.118749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be655c-ac17-4064-999c-f93bcd26908c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:06.129260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-58be655c-ac17-4064-999c-f93bcd26908c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:06.158449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2a15f5-c011-4c6e-9b22-cd1b874a3e64 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:06.247766 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58be655c-ac17-4064-999c-f93bcd26908c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:06.259270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d65589f-6188-4252-832c-bf1ed5330cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:06.260331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65589f-6188-4252-832c-bf1ed5330cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:06.263000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65589f-6188-4252-832c-bf1ed5330cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:06.263416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d65589f-6188-4252-832c-bf1ed5330cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:06.267676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65589f-6188-4252-832c-bf1ed5330cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:06.267676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d65589f-6188-4252-832c-bf1ed5330cc0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:06.298595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 869/1749] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:06.300976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621629b-f51d-4e46-b027-d8e54c9a109a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:06.300976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621629b-f51d-4e46-b027-d8e54c9a109a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:06.300976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9621629b-f51d-4e46-b027-d8e54c9a109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:06.316615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae8e3c-0ff0-4607-8e50-812b1ab6284b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:06.317244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae8e3c-0ff0-4607-8e50-812b1ab6284b admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:06.317528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae8e3c-0ff0-4607-8e50-812b1ab6284b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:06.317983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ae8e3c-0ff0-4607-8e50-812b1ab6284b admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:06.318825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae8e3c-0ff0-4607-8e50-812b1ab6284b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:06.319139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae8e3c-0ff0-4607-8e50-812b1ab6284b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:06.321600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ae8e3c-0ff0-4607-8e50-812b1ab6284b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:06.335692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 881/1750] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:06.336810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae8e3c-0ff0-4607-8e50-812b1ab6284b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:06.346773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9621629b-f51d-4e46-b027-d8e54c9a109a None None] MFA Rules not processed for user `529b916707e54aceb2f324a0d1a7f138`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:06.348189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9621629b-f51d-4e46-b027-d8e54c9a109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:06.351820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ae8e3c-0ff0-4607-8e50-812b1ab6284b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:06.357693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd0807-780a-4c5e-94e2-c84df62d7f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:06.358730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd0807-780a-4c5e-94e2-c84df62d7f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:06.359441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd0807-780a-4c5e-94e2-c84df62d7f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:06.359831 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd0807-780a-4c5e-94e2-c84df62d7f8c admin admin] PATH_INFO: `/v3/projects/60035531dcf84000af63df0afd0a6b23/users/262a39c3483a4ce5bb2d17da8b8cad79/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:06.363535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd0807-780a-4c5e-94e2-c84df62d7f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=60035531dcf84000af63df0afd0a6b23, user_id=262a39c3483a4ce5bb2d17da8b8cad79, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:06.367123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cd0807-780a-4c5e-94e2-c84df62d7f8c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:06.383814 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 882/1751] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:06 2022] PUT /identity/v3/projects/60035531dcf84000af63df0afd0a6b23/users/262a39c3483a4ce5bb2d17da8b8cad79/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:06.388894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1eeb-fd89-4446-a124-e035c096630d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:06.389255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1eeb-fd89-4446-a124-e035c096630d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:06.389603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a1eeb-fd89-4446-a124-e035c096630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:06.429249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ca0a1eeb-fd89-4446-a124-e035c096630d None None] MFA Rules not processed for user `2d5f07704f014ae7a4997fca3c2faa6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:06.432463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ca0a1eeb-fd89-4446-a124-e035c096630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:06.459870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 870/1752] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:06.460891 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621629b-f51d-4e46-b027-d8e54c9a109a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:06.473966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9621629b-f51d-4e46-b027-d8e54c9a109a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:06.556240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 883/1753] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:06.559411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5e4f3-9ade-48d0-b6be-cf1c69a89289 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:06.559729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5e4f3-9ade-48d0-b6be-cf1c69a89289 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:06.560723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba5e4f3-9ade-48d0-b6be-cf1c69a89289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:06.612211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfbd84-cb34-4fe1-aaa1-5ed3cfafa009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:06.614254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfbd84-cb34-4fe1-aaa1-5ed3cfafa009 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:06.614535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfbd84-cb34-4fe1-aaa1-5ed3cfafa009 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:06.615834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abfbd84-cb34-4fe1-aaa1-5ed3cfafa009 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:06.618184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfbd84-cb34-4fe1-aaa1-5ed3cfafa009 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:06.624313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abfbd84-cb34-4fe1-aaa1-5ed3cfafa009 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:06.627543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-2ba5e4f3-9ade-48d0-b6be-cf1c69a89289 None None] MFA Rules not processed for user `262a39c3483a4ce5bb2d17da8b8cad79`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:06.629789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2ba5e4f3-9ade-48d0-b6be-cf1c69a89289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:06.754597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 884/1754] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:06 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:06.755334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5e4f3-9ade-48d0-b6be-cf1c69a89289 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:06.771246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2ba5e4f3-9ade-48d0-b6be-cf1c69a89289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:06.788777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba5e4f3-9ade-48d0-b6be-cf1c69a89289 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:06.795591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d953b-1d96-4114-80dd-6f5e3b8dc767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:06.798101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d953b-1d96-4114-80dd-6f5e3b8dc767 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:06.798101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d953b-1d96-4114-80dd-6f5e3b8dc767 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:06.798101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51d953b-1d96-4114-80dd-6f5e3b8dc767 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:06.799127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d953b-1d96-4114-80dd-6f5e3b8dc767 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:06.801805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51d953b-1d96-4114-80dd-6f5e3b8dc767 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:06.825040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 871/1755] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:06 2022] POST /identity/v3/projects => generated 363 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:06.826046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfbd84-cb34-4fe1-aaa1-5ed3cfafa009 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:06.831064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1abfbd84-cb34-4fe1-aaa1-5ed3cfafa009 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:06.930597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abfbd84-cb34-4fe1-aaa1-5ed3cfafa009 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:06.934897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8287c-6246-4afb-8d5e-b98e63e5ba20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:06.936047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8287c-6246-4afb-8d5e-b98e63e5ba20 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:06.936328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8287c-6246-4afb-8d5e-b98e63e5ba20 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:06.936967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f8287c-6246-4afb-8d5e-b98e63e5ba20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:07.034096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 885/1756] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:06 2022] POST /identity/v3/projects => generated 371 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:07.035212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d953b-1d96-4114-80dd-6f5e3b8dc767 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:07.099649 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8287c-6246-4afb-8d5e-b98e63e5ba20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:07.104773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f8287c-6246-4afb-8d5e-b98e63e5ba20 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:07.130336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 872/1757] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:06 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:07.132260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8287c-6246-4afb-8d5e-b98e63e5ba20 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:07.134534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b0f8287c-6246-4afb-8d5e-b98e63e5ba20 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:07.252225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51d953b-1d96-4114-80dd-6f5e3b8dc767 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:07.278519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d404416-238e-4fb5-9e3d-5f8e55ebe434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:07.279161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404416-238e-4fb5-9e3d-5f8e55ebe434 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:07.286161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404416-238e-4fb5-9e3d-5f8e55ebe434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:07.286580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d404416-238e-4fb5-9e3d-5f8e55ebe434 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:07.290838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d404416-238e-4fb5-9e3d-5f8e55ebe434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:07.293930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d404416-238e-4fb5-9e3d-5f8e55ebe434 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:07.324644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f8287c-6246-4afb-8d5e-b98e63e5ba20 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:07.337418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:07.339389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:07.340670 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:07.341760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] PATH_INFO: `/v3/projects/4b2f66a4e22a45789ff605a5d3844a39` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:07.345732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2f66a4e22a45789ff605a5d3844a39)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:07.349984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:07.421574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:07.438478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 886/1758] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:07 2022] POST /identity/v3/users => generated 282 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:07.440148 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d404416-238e-4fb5-9e3d-5f8e55ebe434 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:07.466662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d404416-238e-4fb5-9e3d-5f8e55ebe434 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:07.483713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ea2e6-076e-4dfe-aca8-3a0b775b3cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:07.484433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ea2e6-076e-4dfe-aca8-3a0b775b3cca admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:07.484618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ea2e6-076e-4dfe-aca8-3a0b775b3cca admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:07.484893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ea2e6-076e-4dfe-aca8-3a0b775b3cca admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:07.485537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ea2e6-076e-4dfe-aca8-3a0b775b3cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:07.487459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ea2e6-076e-4dfe-aca8-3a0b775b3cca admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:07.601104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2f66a4e22a45789ff605a5d3844a39', 'request_id': 'req-a33b4fdd-742c-4b79-a619-a5be7b632fd3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:07.635400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 887/1759] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:07 2022] POST /identity/v3/users => generated 292 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:07.636896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ea2e6-076e-4dfe-aca8-3a0b775b3cca admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:07.653281 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ea2e6-076e-4dfe-aca8-3a0b775b3cca admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:07.744239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0acf9-0401-4de6-89ba-229776390845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:07.744239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0acf9-0401-4de6-89ba-229776390845 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:07.744239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0acf9-0401-4de6-89ba-229776390845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:07.744455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0acf9-0401-4de6-89ba-229776390845 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:07.745224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0acf9-0401-4de6-89ba-229776390845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:07.747088 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0acf9-0401-4de6-89ba-229776390845 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:07.763888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 888/1760] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:07.763888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0acf9-0401-4de6-89ba-229776390845 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:07.769570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2f66a4e22a45789ff605a5d3844a39', 'request_id': 'req-a33b4fdd-742c-4b79-a619-a5be7b632fd3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:07.778468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0acf9-0401-4de6-89ba-229776390845 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:07.780046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2f66a4e22a45789ff605a5d3844a39', 'request_id': 'req-a33b4fdd-742c-4b79-a619-a5be7b632fd3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:07.789430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8b27b-2cfa-4485-b697-3fb7f3c51355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:07.790748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b27b-2cfa-4485-b697-3fb7f3c51355 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:07.791030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b27b-2cfa-4485-b697-3fb7f3c51355 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:07.791300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8b27b-2cfa-4485-b697-3fb7f3c51355 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:07.796051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8b27b-2cfa-4485-b697-3fb7f3c51355 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:07.802747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8b27b-2cfa-4485-b697-3fb7f3c51355 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:07.826426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 889/1761] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:07.826426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8b27b-2cfa-4485-b697-3fb7f3c51355 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:07.831197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] The token cache is being invalidate because project 4b2f66a4e22a45789ff605a5d3844a39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:07.831410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:07.833486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:07.837255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 873/1762] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:07 2022] DELETE /identity/v3/projects/4b2f66a4e22a45789ff605a5d3844a39 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:07.838977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:07.844202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:07.850361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8b27b-2cfa-4485-b697-3fb7f3c51355 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:07.861350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad306-8a22-4238-b31e-aaae0bd293f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:07.863213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad306-8a22-4238-b31e-aaae0bd293f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:07.863539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad306-8a22-4238-b31e-aaae0bd293f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:07.866392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7ad306-8a22-4238-b31e-aaae0bd293f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:07.867289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad306-8a22-4238-b31e-aaae0bd293f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:07.871073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7ad306-8a22-4238-b31e-aaae0bd293f5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:07.893646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 890/1763] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:07.894794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad306-8a22-4238-b31e-aaae0bd293f5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:07.897693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1d7ad306-8a22-4238-b31e-aaae0bd293f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:07.915255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7ad306-8a22-4238-b31e-aaae0bd293f5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:07.921545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a0c653-9b1c-45d7-ab46-2d3b3b8b7e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:07.922433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c653-9b1c-45d7-ab46-2d3b3b8b7e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:07.922782 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c653-9b1c-45d7-ab46-2d3b3b8b7e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:07.923127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a0c653-9b1c-45d7-ab46-2d3b3b8b7e4c admin admin] PATH_INFO: `/v3/projects/4001dd25828f4374950f91fe0a1d45f0/users/0de803a1aac743f08d1cf91475ac36fa/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:07.947159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0c653-9b1c-45d7-ab46-2d3b3b8b7e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4001dd25828f4374950f91fe0a1d45f0, user_id=0de803a1aac743f08d1cf91475ac36fa, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:07.956062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a0c653-9b1c-45d7-ab46-2d3b3b8b7e4c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:07.970638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33b4fdd-742c-4b79-a619-a5be7b632fd3 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:07.974624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:07.975239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:07.975536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:07.975824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:07.977814 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:08.077901 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:08.082879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 891/1764] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:07 2022] PUT /identity/v3/projects/4001dd25828f4374950f91fe0a1d45f0/users/0de803a1aac743f08d1cf91475ac36fa/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:08.084766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a26bfd-d92d-4517-b722-425f5348c378 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.084766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a26bfd-d92d-4517-b722-425f5348c378 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.086304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a26bfd-d92d-4517-b722-425f5348c378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.128917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:08.130598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:08.140838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-60a26bfd-d92d-4517-b722-425f5348c378 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:08.143721 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-60a26bfd-d92d-4517-b722-425f5348c378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:08.195658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 874/1765] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:07 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:08.196626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:08.205364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:08.242128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23e1c2c-18da-4bb5-9093-210712667211 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:08.300920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 892/1766] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:08.302208 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a26bfd-d92d-4517-b722-425f5348c378 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:08.313096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a26bfd-d92d-4517-b722-425f5348c378 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:08.319311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3cca53-65f3-4039-81bc-2258c9773f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:08.320492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cca53-65f3-4039-81bc-2258c9773f5e admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.320973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cca53-65f3-4039-81bc-2258c9773f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.321546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3cca53-65f3-4039-81bc-2258c9773f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.322416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cca53-65f3-4039-81bc-2258c9773f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:08.331177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3cca53-65f3-4039-81bc-2258c9773f5e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:08.352303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 893/1767] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:08.352303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6de63-594e-44bb-af9f-39159b0afd81 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.352303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6de63-594e-44bb-af9f-39159b0afd81 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.352303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6de63-594e-44bb-af9f-39159b0afd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.372271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-7ee6de63-594e-44bb-af9f-39159b0afd81 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:08.373915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7ee6de63-594e-44bb-af9f-39159b0afd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:08.393254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a77d04-c688-4754-8cbd-f87c817d82e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:08.394087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a77d04-c688-4754-8cbd-f87c817d82e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.395200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a77d04-c688-4754-8cbd-f87c817d82e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.396976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a77d04-c688-4754-8cbd-f87c817d82e9 admin admin] PATH_INFO: `/v3/projects/70d1f765d25f4aec9aa8dcc83042ff7b/users/fee0ecdd13ca491eaf89c469c1d4e109/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.409838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 894/1768] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:08.413393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6de63-594e-44bb-af9f-39159b0afd81 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:08.431043 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6de63-594e-44bb-af9f-39159b0afd81 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:08.437936 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939603-df22-4913-a8b8-85aeafc451a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:08.438739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939603-df22-4913-a8b8-85aeafc451a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.439262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939603-df22-4913-a8b8-85aeafc451a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.439345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd939603-df22-4913-a8b8-85aeafc451a3 admin admin] PATH_INFO: `/v3/projects/4001dd25828f4374950f91fe0a1d45f0/users/0de803a1aac743f08d1cf91475ac36fa/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.441654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd939603-df22-4913-a8b8-85aeafc451a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4001dd25828f4374950f91fe0a1d45f0, user_id=0de803a1aac743f08d1cf91475ac36fa, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:08.444495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd939603-df22-4913-a8b8-85aeafc451a3 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:08.450070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a77d04-c688-4754-8cbd-f87c817d82e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70d1f765d25f4aec9aa8dcc83042ff7b, user_id=fee0ecdd13ca491eaf89c469c1d4e109, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:08.456014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a77d04-c688-4754-8cbd-f87c817d82e9 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:08.471351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 895/1769] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:08 2022] PUT /identity/v3/projects/4001dd25828f4374950f91fe0a1d45f0/users/0de803a1aac743f08d1cf91475ac36fa/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:08.472586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939603-df22-4913-a8b8-85aeafc451a3 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:08.555119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd939603-df22-4913-a8b8-85aeafc451a3 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:08.568397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45815d30-646e-425a-b0b1-608d008defae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:08.568397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45815d30-646e-425a-b0b1-608d008defae admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.568397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45815d30-646e-425a-b0b1-608d008defae admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.568397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45815d30-646e-425a-b0b1-608d008defae admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.568724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45815d30-646e-425a-b0b1-608d008defae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:08.568889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45815d30-646e-425a-b0b1-608d008defae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:08.570725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45815d30-646e-425a-b0b1-608d008defae admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:08.611214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 896/1770] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:08.611214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2918d8-df88-4893-9120-1bd6edef6917 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.611214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2918d8-df88-4893-9120-1bd6edef6917 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.611214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2918d8-df88-4893-9120-1bd6edef6917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.624043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 875/1771] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:08 2022] PUT /identity/v3/projects/70d1f765d25f4aec9aa8dcc83042ff7b/users/fee0ecdd13ca491eaf89c469c1d4e109/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:08.636555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c78fe2-e10e-4a3f-8ce7-29dbc9720647 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.639488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c78fe2-e10e-4a3f-8ce7-29dbc9720647 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.641415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c78fe2-e10e-4a3f-8ce7-29dbc9720647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.642680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8e2918d8-df88-4893-9120-1bd6edef6917 None None] MFA Rules not processed for user `0de803a1aac743f08d1cf91475ac36fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:08.644227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8e2918d8-df88-4893-9120-1bd6edef6917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:08.729727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b0c78fe2-e10e-4a3f-8ce7-29dbc9720647 None None] MFA Rules not processed for user `b9aef63cad18473994760d8bbc6faae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:08.731295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b0c78fe2-e10e-4a3f-8ce7-29dbc9720647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:08.747100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 897/1772] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:08.752604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2918d8-df88-4893-9120-1bd6edef6917 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:08.799289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 876/1773] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:08.800594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4b64-fedc-43b9-ac02-7ebfff5fd20e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.800881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4b64-fedc-43b9-ac02-7ebfff5fd20e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.801157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa4b64-fedc-43b9-ac02-7ebfff5fd20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.844537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-94fa4b64-fedc-43b9-ac02-7ebfff5fd20e None None] MFA Rules not processed for user `fee0ecdd13ca491eaf89c469c1d4e109`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:08.845913 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-94fa4b64-fedc-43b9-ac02-7ebfff5fd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:08.928542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2918d8-df88-4893-9120-1bd6edef6917 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:08.946537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c4a25-3d81-4f9c-bbc0-446d90a40050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:08.947170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4a25-3d81-4f9c-bbc0-446d90a40050 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:08.947453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4a25-3d81-4f9c-bbc0-446d90a40050 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:08.947750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c4a25-3d81-4f9c-bbc0-446d90a40050 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:08.948387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c4a25-3d81-4f9c-bbc0-446d90a40050 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:08.951714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 877/1774] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:08.952875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4b64-fedc-43b9-ac02-7ebfff5fd20e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:08.954335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-94fa4b64-fedc-43b9-ac02-7ebfff5fd20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:08.956595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51c4a25-3d81-4f9c-bbc0-446d90a40050 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.041544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa4b64-fedc-43b9-ac02-7ebfff5fd20e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.047788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadee52-3dd8-4d77-92e4-94454a135d64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.048451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadee52-3dd8-4d77-92e4-94454a135d64 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.048736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadee52-3dd8-4d77-92e4-94454a135d64 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.049300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cadee52-3dd8-4d77-92e4-94454a135d64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.067562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadee52-3dd8-4d77-92e4-94454a135d64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.069508 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cadee52-3dd8-4d77-92e4-94454a135d64 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.082768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 878/1775] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:08 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:09.084331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadee52-3dd8-4d77-92e4-94454a135d64 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.099929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 898/1776] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:08 2022] POST /identity/v3/projects => generated 381 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:09.100031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cadee52-3dd8-4d77-92e4-94454a135d64 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.102613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c4a25-3d81-4f9c-bbc0-446d90a40050 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.219555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc903411-f8b0-44bd-97e0-84518621258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.225267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc903411-f8b0-44bd-97e0-84518621258f admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.225267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc903411-f8b0-44bd-97e0-84518621258f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.225267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc903411-f8b0-44bd-97e0-84518621258f admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.225267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc903411-f8b0-44bd-97e0-84518621258f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.225267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc903411-f8b0-44bd-97e0-84518621258f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.237561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c4a25-3d81-4f9c-bbc0-446d90a40050 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.259019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e62bf-9ac2-4835-8fac-86487f9c5777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.259687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e62bf-9ac2-4835-8fac-86487f9c5777 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.260138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e62bf-9ac2-4835-8fac-86487f9c5777 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.260579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e62bf-9ac2-4835-8fac-86487f9c5777 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.261374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e62bf-9ac2-4835-8fac-86487f9c5777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.264065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e62bf-9ac2-4835-8fac-86487f9c5777 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.384101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 879/1777] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:09 2022] POST /identity/v3/projects => generated 365 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:09.388072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc903411-f8b0-44bd-97e0-84518621258f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.456932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc903411-f8b0-44bd-97e0-84518621258f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.469103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 899/1778] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:09 2022] POST /identity/v3/users => generated 291 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:09.469914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe32afe-68a6-47b8-8cce-de9f865d7c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.470541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe32afe-68a6-47b8-8cce-de9f865d7c2b admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.470821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe32afe-68a6-47b8-8cce-de9f865d7c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.471099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe32afe-68a6-47b8-8cce-de9f865d7c2b admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.476444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe32afe-68a6-47b8-8cce-de9f865d7c2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.476584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e62bf-9ac2-4835-8fac-86487f9c5777 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.476678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe32afe-68a6-47b8-8cce-de9f865d7c2b admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.483471 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e62bf-9ac2-4835-8fac-86487f9c5777 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.489165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968efd-778c-47c3-b81c-12e7016cf915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.490295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968efd-778c-47c3-b81c-12e7016cf915 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.490720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968efd-778c-47c3-b81c-12e7016cf915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.491129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968efd-778c-47c3-b81c-12e7016cf915 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.491957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2968efd-778c-47c3-b81c-12e7016cf915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.493707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2968efd-778c-47c3-b81c-12e7016cf915 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.519041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 900/1779] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:09.530530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968efd-778c-47c3-b81c-12e7016cf915 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.544870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968efd-778c-47c3-b81c-12e7016cf915 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.552546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd37edc-acc1-4a4f-b687-e39abcea3d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.553227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd37edc-acc1-4a4f-b687-e39abcea3d22 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.553515 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd37edc-acc1-4a4f-b687-e39abcea3d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.553793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd37edc-acc1-4a4f-b687-e39abcea3d22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.556612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd37edc-acc1-4a4f-b687-e39abcea3d22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.557257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd37edc-acc1-4a4f-b687-e39abcea3d22 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.573470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 901/1780] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:09.575402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd37edc-acc1-4a4f-b687-e39abcea3d22 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.621897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 880/1781] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:09 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:09.622807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe32afe-68a6-47b8-8cce-de9f865d7c2b admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.644097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe32afe-68a6-47b8-8cce-de9f865d7c2b admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.651977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73812c3-f8ff-446f-9490-5a51f6375e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.653936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73812c3-f8ff-446f-9490-5a51f6375e35 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.654109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73812c3-f8ff-446f-9490-5a51f6375e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.654442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73812c3-f8ff-446f-9490-5a51f6375e35 admin admin] PATH_INFO: `/v3/projects/e527db4ff6f14149b5bd339965ead069/users/7eeb824f44874b49a13f02cddd8325dd/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.666345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd37edc-acc1-4a4f-b687-e39abcea3d22 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.671044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36219-459e-4a4f-ba72-139d65d69250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.671692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36219-459e-4a4f-ba72-139d65d69250 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.671972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36219-459e-4a4f-ba72-139d65d69250 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.672240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e36219-459e-4a4f-ba72-139d65d69250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.673579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73812c3-f8ff-446f-9490-5a51f6375e35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e527db4ff6f14149b5bd339965ead069, user_id=7eeb824f44874b49a13f02cddd8325dd, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.674031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d9e36219-459e-4a4f-ba72-139d65d69250 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:09.676709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73812c3-f8ff-446f-9490-5a51f6375e35 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.740969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e36219-459e-4a4f-ba72-139d65d69250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.742468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e36219-459e-4a4f-ba72-139d65d69250 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.757507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 902/1782] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:09.758623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36219-459e-4a4f-ba72-139d65d69250 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.771145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e36219-459e-4a4f-ba72-139d65d69250 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.779897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4faa36-58e5-42a1-8ac1-14d9d20529d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.800207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4faa36-58e5-42a1-8ac1-14d9d20529d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.800963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4faa36-58e5-42a1-8ac1-14d9d20529d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.801530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4faa36-58e5-42a1-8ac1-14d9d20529d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.802734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4faa36-58e5-42a1-8ac1-14d9d20529d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.805863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4faa36-58e5-42a1-8ac1-14d9d20529d7 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.823387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 903/1783] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:09.827764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4faa36-58e5-42a1-8ac1-14d9d20529d7 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:09.841103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4faa36-58e5-42a1-8ac1-14d9d20529d7 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:09.846327 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c27f8-a90d-4c3b-9e6b-1a01509508d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:09.847023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c27f8-a90d-4c3b-9e6b-1a01509508d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.847338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c27f8-a90d-4c3b-9e6b-1a01509508d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.847665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c27f8-a90d-4c3b-9e6b-1a01509508d1 admin admin] PATH_INFO: `/v3/projects/41b63b88e10e43a6abc73d1be6b5bb7d/users/15e71050d1444ad9b8eb24ab79cf2922/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.868475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 881/1784] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:09 2022] PUT /identity/v3/projects/e527db4ff6f14149b5bd339965ead069/users/7eeb824f44874b49a13f02cddd8325dd/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:09.870588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c27f8-a90d-4c3b-9e6b-1a01509508d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b63b88e10e43a6abc73d1be6b5bb7d, user_id=15e71050d1444ad9b8eb24ab79cf2922, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:09.873419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c27f8-a90d-4c3b-9e6b-1a01509508d1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:09.879014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d56f5-da02-43eb-ac63-377d840b116e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:09.879101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d56f5-da02-43eb-ac63-377d840b116e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:09.879635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d56f5-da02-43eb-ac63-377d840b116e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:09.922497 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:09.934868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-0f9d56f5-da02-43eb-ac63-377d840b116e None None] MFA Rules not processed for user `7eeb824f44874b49a13f02cddd8325dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:09.936244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0f9d56f5-da02-43eb-ac63-377d840b116e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:10.029815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 904/1785] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:09 2022] PUT /identity/v3/projects/41b63b88e10e43a6abc73d1be6b5bb7d/users/15e71050d1444ad9b8eb24ab79cf2922/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:10.031029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c27f8-a90d-4c3b-9e6b-1a01509508d1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:10.069357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 882/1786] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:10.070299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d56f5-da02-43eb-ac63-377d840b116e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:10.163206 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c27f8-a90d-4c3b-9e6b-1a01509508d1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:10.169159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402c330-a15b-446d-8445-134333a14737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:10.169824 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402c330-a15b-446d-8445-134333a14737 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:10.170113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402c330-a15b-446d-8445-134333a14737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:10.170409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1402c330-a15b-446d-8445-134333a14737 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:10.171019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402c330-a15b-446d-8445-134333a14737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:10.172715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1402c330-a15b-446d-8445-134333a14737 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:10.188273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 905/1787] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:10 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:10.202083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402c330-a15b-446d-8445-134333a14737 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:10.202232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d56f5-da02-43eb-ac63-377d840b116e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:10.204822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1402c330-a15b-446d-8445-134333a14737 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:10.211308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9529e-a7ec-463e-bd17-e99e80502226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:10.212242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9529e-a7ec-463e-bd17-e99e80502226 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:10.212523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9529e-a7ec-463e-bd17-e99e80502226 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:10.212794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9529e-a7ec-463e-bd17-e99e80502226 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:10.213485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9529e-a7ec-463e-bd17-e99e80502226 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:10.213598 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cad9acf-0a80-46a9-baae-e2a2ab890ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:10.214167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad9acf-0a80-46a9-baae-e2a2ab890ccb admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:10.214454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad9acf-0a80-46a9-baae-e2a2ab890ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:10.214964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cad9acf-0a80-46a9-baae-e2a2ab890ccb admin admin] PATH_INFO: `/v3/projects/41b63b88e10e43a6abc73d1be6b5bb7d/users/15e71050d1444ad9b8eb24ab79cf2922/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:10.215590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9529e-a7ec-463e-bd17-e99e80502226 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:10.220458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad9acf-0a80-46a9-baae-e2a2ab890ccb admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b63b88e10e43a6abc73d1be6b5bb7d, user_id=15e71050d1444ad9b8eb24ab79cf2922, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:10.227908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cad9acf-0a80-46a9-baae-e2a2ab890ccb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:10.255611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 906/1788] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:10 2022] PUT /identity/v3/projects/41b63b88e10e43a6abc73d1be6b5bb7d/users/15e71050d1444ad9b8eb24ab79cf2922/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:10.261501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716bfd-4e07-4096-b300-f15867789e94 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:10.261791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716bfd-4e07-4096-b300-f15867789e94 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:10.262660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716bfd-4e07-4096-b300-f15867789e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:10.327355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-68716bfd-4e07-4096-b300-f15867789e94 None None] MFA Rules not processed for user `15e71050d1444ad9b8eb24ab79cf2922`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:10.334711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-68716bfd-4e07-4096-b300-f15867789e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:10.395160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 883/1789] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:10 2022] POST /identity/v3/projects => generated 379 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:10.408990 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9529e-a7ec-463e-bd17-e99e80502226 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:10.609984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 907/1790] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:10.618669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b5d4-755c-4601-84ee-fa792114ec4e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:10.620752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b5d4-755c-4601-84ee-fa792114ec4e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:10.624285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b5d4-755c-4601-84ee-fa792114ec4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:10.717086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9529e-a7ec-463e-bd17-e99e80502226 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:10.731577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f63b74-23d5-4101-a971-0e49a809c323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:10.732498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f63b74-23d5-4101-a971-0e49a809c323 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:10.732951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f63b74-23d5-4101-a971-0e49a809c323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:10.733699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f63b74-23d5-4101-a971-0e49a809c323 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:10.735305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f63b74-23d5-4101-a971-0e49a809c323 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:10.741938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f63b74-23d5-4101-a971-0e49a809c323 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:10.756616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f4d6b5d4-755c-4601-84ee-fa792114ec4e None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:10.758173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f4d6b5d4-755c-4601-84ee-fa792114ec4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:10.850134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 908/1791] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:52:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:10.850956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b5d4-755c-4601-84ee-fa792114ec4e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:10.933469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b5d4-755c-4601-84ee-fa792114ec4e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:10.933469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a9144-cfde-46e1-8bf2-3be40f15fdeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:10.933469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a9144-cfde-46e1-8bf2-3be40f15fdeb service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:10.934373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a9144-cfde-46e1-8bf2-3be40f15fdeb service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:10.934697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a9144-cfde-46e1-8bf2-3be40f15fdeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:11.003381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a9144-cfde-46e1-8bf2-3be40f15fdeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:11.005077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6a9144-cfde-46e1-8bf2-3be40f15fdeb service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:11.006438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 884/1792] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:10 2022] POST /identity/v3/users => generated 296 bytes in 600 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:11.007231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f63b74-23d5-4101-a971-0e49a809c323 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:11.016560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 909/1793] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:11.019375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f63b74-23d5-4101-a971-0e49a809c323 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:11.033562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52abc5a-153a-4f62-a2d3-ef6196020c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:11.034273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52abc5a-153a-4f62-a2d3-ef6196020c19 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:11.034461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52abc5a-153a-4f62-a2d3-ef6196020c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:11.034738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52abc5a-153a-4f62-a2d3-ef6196020c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:11.035401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52abc5a-153a-4f62-a2d3-ef6196020c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:11.037140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52abc5a-153a-4f62-a2d3-ef6196020c19 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:11.051578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 885/1794] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:11.060777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a9144-cfde-46e1-8bf2-3be40f15fdeb service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:11.072407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6a9144-cfde-46e1-8bf2-3be40f15fdeb service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:11.077344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65eec-b89e-4ecd-b44e-abcb5045e63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:11.078006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65eec-b89e-4ecd-b44e-abcb5045e63e admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:11.078285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65eec-b89e-4ecd-b44e-abcb5045e63e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:11.078556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca65eec-b89e-4ecd-b44e-abcb5045e63e admin admin] PATH_INFO: `/v3/projects/242f3bceb22f473c8d4977b66be3ed36/users/41f642c127b14fd99e52d8b353156fcc/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:11.093432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca65eec-b89e-4ecd-b44e-abcb5045e63e admin admin] RBAC: Authorizing `identity:create_grant(project_id=242f3bceb22f473c8d4977b66be3ed36, user_id=41f642c127b14fd99e52d8b353156fcc, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:11.096115 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca65eec-b89e-4ecd-b44e-abcb5045e63e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:11.256277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 910/1795] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:11 2022] PUT /identity/v3/projects/242f3bceb22f473c8d4977b66be3ed36/users/41f642c127b14fd99e52d8b353156fcc/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:11.257109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52abc5a-153a-4f62-a2d3-ef6196020c19 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:11.268938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52abc5a-153a-4f62-a2d3-ef6196020c19 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:11.331293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65eec-b89e-4ecd-b44e-abcb5045e63e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:11.334175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4ca65eec-b89e-4ecd-b44e-abcb5045e63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:11.374435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c6135-0a27-44e1-867a-6c796ccfd980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:11.375394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c6135-0a27-44e1-867a-6c796ccfd980 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:11.376085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c6135-0a27-44e1-867a-6c796ccfd980 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:11.376569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6c6135-0a27-44e1-867a-6c796ccfd980 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:11.377422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c6135-0a27-44e1-867a-6c796ccfd980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:11.379581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6c6135-0a27-44e1-867a-6c796ccfd980 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:11.434282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 886/1796] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:11 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:11.438031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c6135-0a27-44e1-867a-6c796ccfd980 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:11.474563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6c6135-0a27-44e1-867a-6c796ccfd980 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:11.480348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147134e-fcff-4c08-bb2e-442523fd3168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:11.481840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147134e-fcff-4c08-bb2e-442523fd3168 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:11.482300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147134e-fcff-4c08-bb2e-442523fd3168 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:11.482781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9147134e-fcff-4c08-bb2e-442523fd3168 admin admin] PATH_INFO: `/v3/projects/242f3bceb22f473c8d4977b66be3ed36/users/41f642c127b14fd99e52d8b353156fcc/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:11.485379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147134e-fcff-4c08-bb2e-442523fd3168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=242f3bceb22f473c8d4977b66be3ed36, user_id=41f642c127b14fd99e52d8b353156fcc, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:11.490089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9147134e-fcff-4c08-bb2e-442523fd3168 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:11.503788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 887/1797] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:11 2022] PUT /identity/v3/projects/242f3bceb22f473c8d4977b66be3ed36/users/41f642c127b14fd99e52d8b353156fcc/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:11.504960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147134e-fcff-4c08-bb2e-442523fd3168 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:11.614179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9147134e-fcff-4c08-bb2e-442523fd3168 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:11.618914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca65eec-b89e-4ecd-b44e-abcb5045e63e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:11.622227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2417f4d6-03f0-4842-aeed-593bd1da71e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:11.623254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f4d6-03f0-4842-aeed-593bd1da71e4 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:11.624747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f4d6-03f0-4842-aeed-593bd1da71e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:11.625163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417f4d6-03f0-4842-aeed-593bd1da71e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:11.774948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417f4d6-03f0-4842-aeed-593bd1da71e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:11.776744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2417f4d6-03f0-4842-aeed-593bd1da71e4 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:11.798153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac5df09-ef88-4f1c-a65e-40a9c806576a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:11.798976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5df09-ef88-4f1c-a65e-40a9c806576a service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:11.799267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5df09-ef88-4f1c-a65e-40a9c806576a service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:11.799555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac5df09-ef88-4f1c-a65e-40a9c806576a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:11.803358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 888/1798] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:11.807616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d83f9b-9e95-4b7e-947c-8da4fb8152a7 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:11.808160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d83f9b-9e95-4b7e-947c-8da4fb8152a7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:11.808542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d83f9b-9e95-4b7e-947c-8da4fb8152a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:11.845884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:11.886682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-77d83f9b-9e95-4b7e-947c-8da4fb8152a7 None None] MFA Rules not processed for user `41f642c127b14fd99e52d8b353156fcc`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:11.888667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-77d83f9b-9e95-4b7e-947c-8da4fb8152a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:11.995098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5df09-ef88-4f1c-a65e-40a9c806576a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:11.997807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac5df09-ef88-4f1c-a65e-40a9c806576a service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:12.012866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 911/1799] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:52:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:52:12.014587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc794dbc-6798-4b03-8de1-fdd991ff000d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:12.015004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc794dbc-6798-4b03-8de1-fdd991ff000d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:12.015325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc794dbc-6798-4b03-8de1-fdd991ff000d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:12.040105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 889/1800] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:12.070228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-cc794dbc-6798-4b03-8de1-fdd991ff000d None None] MFA Rules not processed for user `a269743c34bc48edaab5c0e3e78074c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:12.074044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cc794dbc-6798-4b03-8de1-fdd991ff000d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:12.237495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 912/1801] 10.222.0.36 () {58 vars in 1015 bytes} [Tue Oct 4 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:12.429499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d83f9b-9e95-4b7e-947c-8da4fb8152a7 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:12.431582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-77d83f9b-9e95-4b7e-947c-8da4fb8152a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:12.456241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d83f9b-9e95-4b7e-947c-8da4fb8152a7 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:12.467763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a3b705-b8be-406e-b5a0-4efef18fba17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:12.469747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b705-b8be-406e-b5a0-4efef18fba17 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:12.469747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b705-b8be-406e-b5a0-4efef18fba17 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:12.469747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a3b705-b8be-406e-b5a0-4efef18fba17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:12.487382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3b705-b8be-406e-b5a0-4efef18fba17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:12.491195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a3b705-b8be-406e-b5a0-4efef18fba17 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:12.510222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 890/1802] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:12.526628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:12.621252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc794dbc-6798-4b03-8de1-fdd991ff000d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:12.634164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc794dbc-6798-4b03-8de1-fdd991ff000d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:12.640306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8065f2b-7cc3-4b57-b957-6d73a42c55bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:12.641361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065f2b-7cc3-4b57-b957-6d73a42c55bd service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:12.641985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065f2b-7cc3-4b57-b957-6d73a42c55bd service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:12.652295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8065f2b-7cc3-4b57-b957-6d73a42c55bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:12.685725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8065f2b-7cc3-4b57-b957-6d73a42c55bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:12.687282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8065f2b-7cc3-4b57-b957-6d73a42c55bd service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:12.733687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 913/1803] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:14.021927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:15.605828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281bd1d-a086-42bd-9981-17bdcf6ecb76 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:15.606463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281bd1d-a086-42bd-9981-17bdcf6ecb76 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:15.606463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f281bd1d-a086-42bd-9981-17bdcf6ecb76 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:15.609051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 891/1804] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:52:15.620071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a78ce9-59a9-4330-b5df-c747a454cd15 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:15.621189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a78ce9-59a9-4330-b5df-c747a454cd15 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:15.621747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a78ce9-59a9-4330-b5df-c747a454cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:15.700778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-58a78ce9-59a9-4330-b5df-c747a454cd15 None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:15.702200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-58a78ce9-59a9-4330-b5df-c747a454cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:15.786372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281bd1d-a086-42bd-9981-17bdcf6ecb76 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:15.863355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f281bd1d-a086-42bd-9981-17bdcf6ecb76 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:15.907813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66336479-8a03-4a01-be38-65a92e71a709 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f642c127b14fd99e52d8b353156fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '242f3bceb22f473c8d4977b66be3ed36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:15.908048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336479-8a03-4a01-be38-65a92e71a709 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:15.910348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336479-8a03-4a01-be38-65a92e71a709 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:15.913410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66336479-8a03-4a01-be38-65a92e71a709 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:15.918806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336479-8a03-4a01-be38-65a92e71a709 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:15.921216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336479-8a03-4a01-be38-65a92e71a709 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:15.930995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66336479-8a03-4a01-be38-65a92e71a709 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:16.018440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 892/1805] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:52:16.025644 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7b02-7083-4bf5-9e5b-67ad3da5a7b6 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:16.030549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7b02-7083-4bf5-9e5b-67ad3da5a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:16.032518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3c7b02-7083-4bf5-9e5b-67ad3da5a7b6 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:16.042532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 893/1806] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:52:16 2022] GET /identity => generated 270 bytes in 23 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:52:16.046907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c7b02-7083-4bf5-9e5b-67ad3da5a7b6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:16.071060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3c7b02-7083-4bf5-9e5b-67ad3da5a7b6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:16.079240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14f84d-467c-4162-ae58-988a5dede7a3 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f642c127b14fd99e52d8b353156fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '242f3bceb22f473c8d4977b66be3ed36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:16.079240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14f84d-467c-4162-ae58-988a5dede7a3 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:16.079240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14f84d-467c-4162-ae58-988a5dede7a3 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:16.089086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14f84d-467c-4162-ae58-988a5dede7a3 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:16.089086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14f84d-467c-4162-ae58-988a5dede7a3 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:16.089086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b14f84d-467c-4162-ae58-988a5dede7a3 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:16.138762 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 914/1807] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:52:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 520 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:16.278420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d79f54-f097-4a06-b8f6-273dfcf95476 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:16.279015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d79f54-f097-4a06-b8f6-273dfcf95476 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:16.279548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d79f54-f097-4a06-b8f6-273dfcf95476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:16.300238 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 894/1808] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:16 2022] POST /identity/v3/projects => generated 355 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:16.305424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14f84d-467c-4162-ae58-988a5dede7a3 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:16.349097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-86d79f54-f097-4a06-b8f6-273dfcf95476 None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:16.359322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-86d79f54-f097-4a06-b8f6-273dfcf95476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:16.510453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b14f84d-467c-4162-ae58-988a5dede7a3 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:16.524203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2c24b-4c40-4d3b-9cdf-f00217b3d9ce tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f642c127b14fd99e52d8b353156fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '242f3bceb22f473c8d4977b66be3ed36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:16.524836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c24b-4c40-4d3b-9cdf-f00217b3d9ce tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:16.525147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c24b-4c40-4d3b-9cdf-f00217b3d9ce tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:16.525396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2c24b-4c40-4d3b-9cdf-f00217b3d9ce tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:16.526075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2c24b-4c40-4d3b-9cdf-f00217b3d9ce tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:16.526470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2c24b-4c40-4d3b-9cdf-f00217b3d9ce tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:16.528381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2c24b-4c40-4d3b-9cdf-f00217b3d9ce tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:16.555301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 895/1809] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:16.561670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 915/1810] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:16.619536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2c24b-4c40-4d3b-9cdf-f00217b3d9ce tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:16.638377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2c24b-4c40-4d3b-9cdf-f00217b3d9ce tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:16.651227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d79f54-f097-4a06-b8f6-273dfcf95476 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:16.651856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '41f642c127b14fd99e52d8b353156fcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '242f3bceb22f473c8d4977b66be3ed36', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:16.652377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:16.653343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:16.653875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] PATH_INFO: `/v3/projects/b5293716259f4a7a9454091435b540b6` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:16.654287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-86d79f54-f097-4a06-b8f6-273dfcf95476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:16.655305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b5293716259f4a7a9454091435b540b6)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:16.657449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:16.681552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d79f54-f097-4a06-b8f6-273dfcf95476 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:16.697189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e630c6-660f-4665-8df1-f8f16a3ca0e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:16.697845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e630c6-660f-4665-8df1-f8f16a3ca0e1 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:16.698108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e630c6-660f-4665-8df1-f8f16a3ca0e1 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:16.698376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e630c6-660f-4665-8df1-f8f16a3ca0e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:16.717456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e630c6-660f-4665-8df1-f8f16a3ca0e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:16.719089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e630c6-660f-4665-8df1-f8f16a3ca0e1 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:16.733911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 916/1811] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:16.902227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5293716259f4a7a9454091435b540b6', 'request_id': 'req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:17.030659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5293716259f4a7a9454091435b540b6', 'request_id': 'req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:17.044280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5293716259f4a7a9454091435b540b6', 'request_id': 'req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:17.077308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] The token cache is being invalidate because project b5293716259f4a7a9454091435b540b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:17.077672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:17.083278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:17.088673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 896/1812] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:16 2022] DELETE /identity/v3/projects/b5293716259f4a7a9454091435b540b6 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:17.145961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e630c6-660f-4665-8df1-f8f16a3ca0e1 service nova] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:17.165572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e630c6-660f-4665-8df1-f8f16a3ca0e1 service nova] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:17.313498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31bda79-954b-4f84-be32-02fea7e378af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:17.314240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bda79-954b-4f84-be32-02fea7e378af service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:17.314591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bda79-954b-4f84-be32-02fea7e378af service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:17.315110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31bda79-954b-4f84-be32-02fea7e378af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:17.317102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c31bda79-954b-4f84-be32-02fea7e378af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:17.343850 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bda79-954b-4f84-be32-02fea7e378af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:17.345821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31bda79-954b-4f84-be32-02fea7e378af service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:17.384037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 917/1813] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:18.386130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:18.752895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:18.754054 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:18.965685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd9f4d-0b33-4f92-b439-9c1035002fd8 tempest-VolumeQuotaClassesTest-232267394 tempest-VolumeQuotaClassesTest-232267394-project-admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:18.979930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:18.981777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:18.984048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:18.984704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] PATH_INFO: `/v3/users/7eeb824f44874b49a13f02cddd8325dd` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:18.988469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eeb824f44874b49a13f02cddd8325dd)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:18.993239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:19.241447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:19.417565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eeb824f44874b49a13f02cddd8325dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:19.447487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eeb824f44874b49a13f02cddd8325dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:19.452338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eeb824f44874b49a13f02cddd8325dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:19.454091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eeb824f44874b49a13f02cddd8325dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:19.576846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eeb824f44874b49a13f02cddd8325dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:19.629070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 897/1814] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:18 2022] DELETE /identity/v3/users/7eeb824f44874b49a13f02cddd8325dd => generated 0 bytes in 875 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:19.635973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d894fb-ee04-444a-97aa-b07e7996be14 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:19.636532 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d894fb-ee04-444a-97aa-b07e7996be14 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:19.636532 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d894fb-ee04-444a-97aa-b07e7996be14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:19.671287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-55d894fb-ee04-444a-97aa-b07e7996be14 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:19.673390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-55d894fb-ee04-444a-97aa-b07e7996be14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:19.820353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 918/1815] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:19.895033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:19.896537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:20.021774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255f1fa-6454-43c3-aafa-e772458f9742 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:20.036337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46069f25-7531-41bb-af28-b9b06eaddb53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:20.038953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46069f25-7531-41bb-af28-b9b06eaddb53 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:20.039316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46069f25-7531-41bb-af28-b9b06eaddb53 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:20.039692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46069f25-7531-41bb-af28-b9b06eaddb53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:20.073490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46069f25-7531-41bb-af28-b9b06eaddb53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:20.075871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46069f25-7531-41bb-af28-b9b06eaddb53 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:20.109781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 898/1816] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:21.362556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d894fb-ee04-444a-97aa-b07e7996be14 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:21.364200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-55d894fb-ee04-444a-97aa-b07e7996be14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:21.382313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d894fb-ee04-444a-97aa-b07e7996be14 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:21.388505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:21.389383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.389818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.390250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] PATH_INFO: `/v3/users/530335ffd42e461ca5c809c261dedcf3` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.391749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] RBAC: Authorizing `identity:delete_user(user_id=530335ffd42e461ca5c809c261dedcf3)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:21.393855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:21.499529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46069f25-7531-41bb-af28-b9b06eaddb53 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:21.501522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-46069f25-7531-41bb-af28-b9b06eaddb53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:21.539462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46069f25-7531-41bb-af28-b9b06eaddb53 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:21.546033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:21.549161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.549161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.549161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] PATH_INFO: `/v3/projects/e527db4ff6f14149b5bd339965ead069` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.549161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e527db4ff6f14149b5bd339965ead069)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:21.580199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:21.662580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '530335ffd42e461ca5c809c261dedcf3'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:21.675579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '530335ffd42e461ca5c809c261dedcf3'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:21.677341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '530335ffd42e461ca5c809c261dedcf3'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:21.678345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '530335ffd42e461ca5c809c261dedcf3'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:21.827169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-15ff9b32-d24e-47db-b8c0-aa2805ab3aaa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '530335ffd42e461ca5c809c261dedcf3'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:21.852982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e527db4ff6f14149b5bd339965ead069', 'request_id': 'req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:21.868001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 919/1817] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:21 2022] DELETE /identity/v3/users/530335ffd42e461ca5c809c261dedcf3 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:21.874093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2e5d3-ac27-4253-ac77-6a02c37443e2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:21.874409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2e5d3-ac27-4253-ac77-6a02c37443e2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:21.875347 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2e5d3-ac27-4253-ac77-6a02c37443e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:21.931681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-2ef2e5d3-ac27-4253-ac77-6a02c37443e2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:21.953128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2ef2e5d3-ac27-4253-ac77-6a02c37443e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:22.010646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e527db4ff6f14149b5bd339965ead069', 'request_id': 'req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.018685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e527db4ff6f14149b5bd339965ead069', 'request_id': 'req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.041974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] The token cache is being invalidate because project e527db4ff6f14149b5bd339965ead069 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:22.042289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.045988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.048848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 899/1818] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:21 2022] DELETE /identity/v3/projects/e527db4ff6f14149b5bd339965ead069 => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:22.053419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:22.054917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:22.124397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 920/1819] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:22.138752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2e5d3-ac27-4253-ac77-6a02c37443e2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:22.142107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2ef2e5d3-ac27-4253-ac77-6a02c37443e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:22.222314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b5f5f-ddb2-43a3-b918-7bb62edb588f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:22.228699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:22.229520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:22.230002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:22.230426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] PATH_INFO: `/v3/users/41f642c127b14fd99e52d8b353156fcc` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:22.234092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41f642c127b14fd99e52d8b353156fcc)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:22.236323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:22.282221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2e5d3-ac27-4253-ac77-6a02c37443e2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:22.294996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c1c3-9af7-4448-a374-16c98f5d6e41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:22.295144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c1c3-9af7-4448-a374-16c98f5d6e41 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:22.295357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c1c3-9af7-4448-a374-16c98f5d6e41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:22.297449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9c1c3-9af7-4448-a374-16c98f5d6e41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:22.313399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9c1c3-9af7-4448-a374-16c98f5d6e41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:22.315608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9c1c3-9af7-4448-a374-16c98f5d6e41 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:22.336502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 921/1820] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:22.751857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41f642c127b14fd99e52d8b353156fcc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.767458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41f642c127b14fd99e52d8b353156fcc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.772004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41f642c127b14fd99e52d8b353156fcc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.776528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41f642c127b14fd99e52d8b353156fcc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.961765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41f642c127b14fd99e52d8b353156fcc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:22.993981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 900/1821] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:22 2022] DELETE /identity/v3/users/41f642c127b14fd99e52d8b353156fcc => generated 0 bytes in 941 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:23.381023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c1c3-9af7-4448-a374-16c98f5d6e41 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:23.383241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-dce9c1c3-9af7-4448-a374-16c98f5d6e41 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:23.401394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9c1c3-9af7-4448-a374-16c98f5d6e41 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:23.504412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:23.593238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:23.597326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:23.598687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:23.601390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] PATH_INFO: `/v3/projects/e409e51649fc47a890a9797e0f676df4` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:23.607976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e409e51649fc47a890a9797e0f676df4)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:23.614402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:23.890394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e409e51649fc47a890a9797e0f676df4', 'request_id': 'req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.421561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e409e51649fc47a890a9797e0f676df4', 'request_id': 'req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.430969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.432087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e409e51649fc47a890a9797e0f676df4', 'request_id': 'req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.432517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:24.444737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] The token cache is being invalidate because project e409e51649fc47a890a9797e0f676df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:24.445034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.445966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.447628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 922/1822] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:23 2022] DELETE /identity/v3/projects/e409e51649fc47a890a9797e0f676df4 => generated 0 bytes in 1067 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:24.450361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44529708-a5d6-4f6b-9a15-0f8b369f6654 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.453513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:24.454806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:24.528207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.530787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.530787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.530787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] PATH_INFO: `/v3/projects/242f3bceb22f473c8d4977b66be3ed36` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.531067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afff9c8b-1d6e-4ce0-9977-030b1bcc70f7 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:24.531156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] RBAC: Authorizing `identity:delete_project(project_id=242f3bceb22f473c8d4977b66be3ed36)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.532664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.534851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:24.535481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:24.535790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:24.536065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] PATH_INFO: `/v3/users/262a39c3483a4ce5bb2d17da8b8cad79` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:24.537227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=262a39c3483a4ce5bb2d17da8b8cad79)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:24.539136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:24.871557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '262a39c3483a4ce5bb2d17da8b8cad79'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.879486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '262a39c3483a4ce5bb2d17da8b8cad79'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.880181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '262a39c3483a4ce5bb2d17da8b8cad79'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.880784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '262a39c3483a4ce5bb2d17da8b8cad79'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.897833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '242f3bceb22f473c8d4977b66be3ed36', 'request_id': 'req-ed91fcbe-9012-44b2-9f68-a646f284998f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.965017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1aa915da-b765-4270-b79d-b728ff7b9d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '262a39c3483a4ce5bb2d17da8b8cad79'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:24.986126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 923/1823] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:24 2022] DELETE /identity/v3/users/262a39c3483a4ce5bb2d17da8b8cad79 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:25.095798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '242f3bceb22f473c8d4977b66be3ed36', 'request_id': 'req-ed91fcbe-9012-44b2-9f68-a646f284998f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:25.102736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '242f3bceb22f473c8d4977b66be3ed36', 'request_id': 'req-ed91fcbe-9012-44b2-9f68-a646f284998f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:25.133094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] The token cache is being invalidate because project 242f3bceb22f473c8d4977b66be3ed36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:25.133094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:25.133094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ed91fcbe-9012-44b2-9f68-a646f284998f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:25.134830 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 901/1824] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:24 2022] DELETE /identity/v3/projects/242f3bceb22f473c8d4977b66be3ed36 => generated 0 bytes in 704 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:25.140132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ed884-1b77-49f2-8e5c-0dbb41360fb2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.140691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ed884-1b77-49f2-8e5c-0dbb41360fb2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.140994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21ed884-1b77-49f2-8e5c-0dbb41360fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.173331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-e21ed884-1b77-49f2-8e5c-0dbb41360fb2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:25.173331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e21ed884-1b77-49f2-8e5c-0dbb41360fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:25.232357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 924/1825] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:25.239996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce854af3-bb91-47af-8cd1-90b5e596c8ec None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.240219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce854af3-bb91-47af-8cd1-90b5e596c8ec None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.240526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce854af3-bb91-47af-8cd1-90b5e596c8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.260329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ce854af3-bb91-47af-8cd1-90b5e596c8ec None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:25.261584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ce854af3-bb91-47af-8cd1-90b5e596c8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:25.269579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 902/1826] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:25.273810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ed884-1b77-49f2-8e5c-0dbb41360fb2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.284877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21ed884-1b77-49f2-8e5c-0dbb41360fb2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.292227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76195e26-2253-4f72-b2b1-2ba92182546f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.293340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76195e26-2253-4f72-b2b1-2ba92182546f admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.294233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76195e26-2253-4f72-b2b1-2ba92182546f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.294508 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76195e26-2253-4f72-b2b1-2ba92182546f admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.295177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76195e26-2253-4f72-b2b1-2ba92182546f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:25.295566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76195e26-2253-4f72-b2b1-2ba92182546f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.298729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76195e26-2253-4f72-b2b1-2ba92182546f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.315696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 925/1827] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:25.317578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce854af3-bb91-47af-8cd1-90b5e596c8ec None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.330182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce854af3-bb91-47af-8cd1-90b5e596c8ec None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.335398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e7160-d7ff-41e0-a1ef-5c1a3ba6f71e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.336084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7160-d7ff-41e0-a1ef-5c1a3ba6f71e admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.336363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7160-d7ff-41e0-a1ef-5c1a3ba6f71e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.336663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e7160-d7ff-41e0-a1ef-5c1a3ba6f71e admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.337316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e7160-d7ff-41e0-a1ef-5c1a3ba6f71e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.341401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e7160-d7ff-41e0-a1ef-5c1a3ba6f71e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.440957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=6,keystone:SELECT=94 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:25.463343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 903/1828] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:25 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:25.468049 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76195e26-2253-4f72-b2b1-2ba92182546f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.479044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76195e26-2253-4f72-b2b1-2ba92182546f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.539881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd197241-2328-4119-95e0-a0d8467c8414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.545917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd197241-2328-4119-95e0-a0d8467c8414 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.545917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd197241-2328-4119-95e0-a0d8467c8414 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.545917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd197241-2328-4119-95e0-a0d8467c8414 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.545917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd197241-2328-4119-95e0-a0d8467c8414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.545917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd197241-2328-4119-95e0-a0d8467c8414 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.590054 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e7160-d7ff-41e0-a1ef-5c1a3ba6f71e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.592706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cf6e7160-d7ff-41e0-a1ef-5c1a3ba6f71e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:25.606715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e7160-d7ff-41e0-a1ef-5c1a3ba6f71e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.611740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.612564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.612848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.613316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] PATH_INFO: `/v3/projects/60035531dcf84000af63df0afd0a6b23` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.614548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60035531dcf84000af63df0afd0a6b23)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.616569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.791391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 926/1829] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:25 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:25.795397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd197241-2328-4119-95e0-a0d8467c8414 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.803641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60035531dcf84000af63df0afd0a6b23', 'request_id': 'req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:25.808707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd197241-2328-4119-95e0-a0d8467c8414 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.863563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161a633-8855-45c9-ba94-ebde68419e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.864171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161a633-8855-45c9-ba94-ebde68419e9d admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.864458 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161a633-8855-45c9-ba94-ebde68419e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.864729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f161a633-8855-45c9-ba94-ebde68419e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.865367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161a633-8855-45c9-ba94-ebde68419e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.866942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f161a633-8855-45c9-ba94-ebde68419e9d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.876743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 927/1830] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:25.877892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161a633-8855-45c9-ba94-ebde68419e9d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.879996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f161a633-8855-45c9-ba94-ebde68419e9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:25.892855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f161a633-8855-45c9-ba94-ebde68419e9d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.897417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.898024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.898301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.898572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] PATH_INFO: `/v3/users/fee0ecdd13ca491eaf89c469c1d4e109` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.899711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee0ecdd13ca491eaf89c469c1d4e109)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.901595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.913433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60035531dcf84000af63df0afd0a6b23', 'request_id': 'req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:25.921728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60035531dcf84000af63df0afd0a6b23', 'request_id': 'req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:25.931648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] The token cache is being invalidate because project 60035531dcf84000af63df0afd0a6b23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:25.931981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:25.932665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:25.934694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 904/1831] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:25 2022] DELETE /identity/v3/projects/60035531dcf84000af63df0afd0a6b23 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:25.935555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:25.936961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:25.949322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c72469c-9fa6-425d-b6fe-e5326fbfdee6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:25.954460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb33f2a-bce2-41a8-a425-9ab8dfc4b008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:25.955041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33f2a-bce2-41a8-a425-9ab8dfc4b008 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.955323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33f2a-bce2-41a8-a425-9ab8dfc4b008 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.955663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb33f2a-bce2-41a8-a425-9ab8dfc4b008 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.956303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb33f2a-bce2-41a8-a425-9ab8dfc4b008 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:25.957994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb33f2a-bce2-41a8-a425-9ab8dfc4b008 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:25.968245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 905/1832] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:25.969575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73887223-2f05-4052-8383-5c918fd438ca None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:25.969866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73887223-2f05-4052-8383-5c918fd438ca None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:25.970143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73887223-2f05-4052-8383-5c918fd438ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:25.990022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-73887223-2f05-4052-8383-5c918fd438ca None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:25.991424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-73887223-2f05-4052-8383-5c918fd438ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:25.999964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 906/1833] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:26.000759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73887223-2f05-4052-8383-5c918fd438ca None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.010024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73887223-2f05-4052-8383-5c918fd438ca None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.015128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa7b982-22da-4e0c-8503-13c6b0d05d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.015781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7b982-22da-4e0c-8503-13c6b0d05d04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.016058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7b982-22da-4e0c-8503-13c6b0d05d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.016327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa7b982-22da-4e0c-8503-13c6b0d05d04 admin admin] PATH_INFO: `/v3/projects/1e927cb4d91c4a23b7318a6048ae03b7/users/ace6f4d34f9e4ffdb5f571520f43802b/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.030453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7b982-22da-4e0c-8503-13c6b0d05d04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e927cb4d91c4a23b7318a6048ae03b7, user_id=ace6f4d34f9e4ffdb5f571520f43802b, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.033161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa7b982-22da-4e0c-8503-13c6b0d05d04 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.150351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee0ecdd13ca491eaf89c469c1d4e109'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:26.157272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee0ecdd13ca491eaf89c469c1d4e109'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:26.157964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee0ecdd13ca491eaf89c469c1d4e109'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:26.158580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee0ecdd13ca491eaf89c469c1d4e109'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:26.170588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 907/1834] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:25 2022] PUT /identity/v3/projects/1e927cb4d91c4a23b7318a6048ae03b7/users/ace6f4d34f9e4ffdb5f571520f43802b/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:26.171943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf208e-b9a5-460b-9ea3-10f9230cc291 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.172291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf208e-b9a5-460b-9ea3-10f9230cc291 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.172576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecf208e-b9a5-460b-9ea3-10f9230cc291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.192903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1ecf208e-b9a5-460b-9ea3-10f9230cc291 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:26.194117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1ecf208e-b9a5-460b-9ea3-10f9230cc291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:26.267265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 908/1835] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:26.267265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed79aac-43a8-433c-9570-94092e99d916 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.267265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed79aac-43a8-433c-9570-94092e99d916 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.267265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed79aac-43a8-433c-9570-94092e99d916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.268808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee0ecdd13ca491eaf89c469c1d4e109'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:26.299680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1ed79aac-43a8-433c-9570-94092e99d916 None None] MFA Rules not processed for user `ace6f4d34f9e4ffdb5f571520f43802b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:26.300945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1ed79aac-43a8-433c-9570-94092e99d916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:26.305454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 928/1836] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:25 2022] DELETE /identity/v3/users/fee0ecdd13ca491eaf89c469c1d4e109 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:26.307029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.381911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9119df1-a7cf-4211-ad7d-a0ffdd5fe2cf admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.390711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 909/1837] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:26.390711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d639-b437-428d-8c33-b96be5a9a72f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.390711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d639-b437-428d-8c33-b96be5a9a72f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.390711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2d639-b437-428d-8c33-b96be5a9a72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.394740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2fba-c46d-45fb-97b0-34da58694dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.395930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2fba-c46d-45fb-97b0-34da58694dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.395930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2fba-c46d-45fb-97b0-34da58694dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.395930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e2fba-c46d-45fb-97b0-34da58694dc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.401255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2fba-c46d-45fb-97b0-34da58694dc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:26.401255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2fba-c46d-45fb-97b0-34da58694dc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.401255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e2fba-c46d-45fb-97b0-34da58694dc4 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.418249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bad2d639-b437-428d-8c33-b96be5a9a72f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:26.420102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bad2d639-b437-428d-8c33-b96be5a9a72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:26.430958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 910/1838] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:26.430958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2d639-b437-428d-8c33-b96be5a9a72f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.431213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 929/1839] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:26.431297 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bad2d639-b437-428d-8c33-b96be5a9a72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:26.437422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2fba-c46d-45fb-97b0-34da58694dc4 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.442496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2d639-b437-428d-8c33-b96be5a9a72f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.447485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dadb2-1b7e-46ae-ab8c-7fb4a50269b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.448133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dadb2-1b7e-46ae-ab8c-7fb4a50269b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.448416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dadb2-1b7e-46ae-ab8c-7fb4a50269b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.448534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e2fba-c46d-45fb-97b0-34da58694dc4 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.448720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243dadb2-1b7e-46ae-ab8c-7fb4a50269b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.449365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dadb2-1b7e-46ae-ab8c-7fb4a50269b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.451354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243dadb2-1b7e-46ae-ab8c-7fb4a50269b7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.453741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb623f70-d02d-417e-b5ff-dec8e7ce4c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.454617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb623f70-d02d-417e-b5ff-dec8e7ce4c6d admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.454871 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb623f70-d02d-417e-b5ff-dec8e7ce4c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.455149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb623f70-d02d-417e-b5ff-dec8e7ce4c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.455825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb623f70-d02d-417e-b5ff-dec8e7ce4c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.457731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb623f70-d02d-417e-b5ff-dec8e7ce4c6d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.589862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 911/1840] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:26 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:26.592610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dadb2-1b7e-46ae-ab8c-7fb4a50269b7 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.594076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-243dadb2-1b7e-46ae-ab8c-7fb4a50269b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:26.633194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 930/1841] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:26 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:26.634872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb623f70-d02d-417e-b5ff-dec8e7ce4c6d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.660206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243dadb2-1b7e-46ae-ab8c-7fb4a50269b7 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.713636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f39f7-6089-43c0-b0eb-4013a7694f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.714203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb623f70-d02d-417e-b5ff-dec8e7ce4c6d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.714397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f39f7-6089-43c0-b0eb-4013a7694f82 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.714848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f39f7-6089-43c0-b0eb-4013a7694f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.715135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f39f7-6089-43c0-b0eb-4013a7694f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.722340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faab37f-df39-4c23-929b-863e1b18afca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.723157 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faab37f-df39-4c23-929b-863e1b18afca admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.723631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faab37f-df39-4c23-929b-863e1b18afca admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.724069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faab37f-df39-4c23-929b-863e1b18afca admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.725635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faab37f-df39-4c23-929b-863e1b18afca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.727763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faab37f-df39-4c23-929b-863e1b18afca admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.730319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f39f7-6089-43c0-b0eb-4013a7694f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.732524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f39f7-6089-43c0-b0eb-4013a7694f82 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.745166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 912/1842] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:26.746021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f39f7-6089-43c0-b0eb-4013a7694f82 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.762696 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f39f7-6089-43c0-b0eb-4013a7694f82 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.768856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6c7f-83c7-40ca-b041-0480d27a23ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.769498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6c7f-83c7-40ca-b041-0480d27a23ec admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.769989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6c7f-83c7-40ca-b041-0480d27a23ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.770327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c6c7f-83c7-40ca-b041-0480d27a23ec admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.771027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c6c7f-83c7-40ca-b041-0480d27a23ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.773059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9c6c7f-83c7-40ca-b041-0480d27a23ec admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.879108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 931/1843] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:26 2022] POST /identity/v3/users => generated 294 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:26.881539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faab37f-df39-4c23-929b-863e1b18afca admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.892011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faab37f-df39-4c23-929b-863e1b18afca admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.896577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7cc08-26da-419c-a159-e2261eacfc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.897230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7cc08-26da-419c-a159-e2261eacfc15 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.897511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7cc08-26da-419c-a159-e2261eacfc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.897781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7cc08-26da-419c-a159-e2261eacfc15 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.898427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7cc08-26da-419c-a159-e2261eacfc15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.900045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7cc08-26da-419c-a159-e2261eacfc15 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.911546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 932/1844] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:26.920105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7cc08-26da-419c-a159-e2261eacfc15 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.925071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 913/1845] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:26 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:26.938088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6c7f-83c7-40ca-b041-0480d27a23ec admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.938282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7cc08-26da-419c-a159-e2261eacfc15 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.938282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916ef5-256c-4320-b905-fbf51ab9b525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.938282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916ef5-256c-4320-b905-fbf51ab9b525 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.938282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916ef5-256c-4320-b905-fbf51ab9b525 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.938592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74916ef5-256c-4320-b905-fbf51ab9b525 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.938592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74916ef5-256c-4320-b905-fbf51ab9b525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.938764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9c6c7f-83c7-40ca-b041-0480d27a23ec admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.939878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74916ef5-256c-4320-b905-fbf51ab9b525 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.942699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5454cc-d801-4f26-9ca2-25c0faa02666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.943370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5454cc-d801-4f26-9ca2-25c0faa02666 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.943713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5454cc-d801-4f26-9ca2-25c0faa02666 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.943993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5454cc-d801-4f26-9ca2-25c0faa02666 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.944647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5454cc-d801-4f26-9ca2-25c0faa02666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.946251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5454cc-d801-4f26-9ca2-25c0faa02666 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.953587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 933/1846] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:26.954533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916ef5-256c-4320-b905-fbf51ab9b525 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.959692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 914/1847] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:26.960505 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5454cc-d801-4f26-9ca2-25c0faa02666 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:26.964971 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74916ef5-256c-4320-b905-fbf51ab9b525 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.970129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6437d2c5-3891-4cc6-b4e2-abe3341df4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.970959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437d2c5-3891-4cc6-b4e2-abe3341df4f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.971108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5454cc-d801-4f26-9ca2-25c0faa02666 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:26.971207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437d2c5-3891-4cc6-b4e2-abe3341df4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.971409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6437d2c5-3891-4cc6-b4e2-abe3341df4f5 admin admin] PATH_INFO: `/v3/projects/a7447ace48c8401faf70af01d2771df2/users/e921bebba8c34dfcbd3683552a6b3a25/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.975690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78d069-5724-4a7d-b9b0-4a91eb86724b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:26.976280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78d069-5724-4a7d-b9b0-4a91eb86724b admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:26.976561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78d069-5724-4a7d-b9b0-4a91eb86724b admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:26.976838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc78d069-5724-4a7d-b9b0-4a91eb86724b admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:26.977509 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78d069-5724-4a7d-b9b0-4a91eb86724b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.979079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc78d069-5724-4a7d-b9b0-4a91eb86724b admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.987004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437d2c5-3891-4cc6-b4e2-abe3341df4f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7447ace48c8401faf70af01d2771df2, user_id=e921bebba8c34dfcbd3683552a6b3a25, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:26.989667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6437d2c5-3891-4cc6-b4e2-abe3341df4f5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:26.990273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 915/1848] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:26.994256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78d069-5724-4a7d-b9b0-4a91eb86724b admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:27.003778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc78d069-5724-4a7d-b9b0-4a91eb86724b admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:27.008456 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6847c025-6134-474d-a376-437ada068125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:27.009023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c025-6134-474d-a376-437ada068125 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.009304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c025-6134-474d-a376-437ada068125 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.009581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6847c025-6134-474d-a376-437ada068125 admin admin] PATH_INFO: `/v3/projects/065a6b5a75454e6e8628cd7a34f75c6b/users/b9835d2c0d204f6a94a8a0545647c9bf/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.024272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847c025-6134-474d-a376-437ada068125 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065a6b5a75454e6e8628cd7a34f75c6b, user_id=b9835d2c0d204f6a94a8a0545647c9bf, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:27.026907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6847c025-6134-474d-a376-437ada068125 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:27.123787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 934/1849] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:26 2022] PUT /identity/v3/projects/a7447ace48c8401faf70af01d2771df2/users/e921bebba8c34dfcbd3683552a6b3a25/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:27.144995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a45cf-9b69-425f-b43c-6297c61d403c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.144995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a45cf-9b69-425f-b43c-6297c61d403c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.144995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a45cf-9b69-425f-b43c-6297c61d403c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.170649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-665a45cf-9b69-425f-b43c-6297c61d403c None None] MFA Rules not processed for user `e921bebba8c34dfcbd3683552a6b3a25`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:27.172105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-665a45cf-9b69-425f-b43c-6297c61d403c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:27.199876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 916/1850] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:26 2022] PUT /identity/v3/projects/065a6b5a75454e6e8628cd7a34f75c6b/users/b9835d2c0d204f6a94a8a0545647c9bf/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:27.202972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109afb-25d2-42af-a46d-970dcbd6e7a3 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.203264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109afb-25d2-42af-a46d-970dcbd6e7a3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.203572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a109afb-25d2-42af-a46d-970dcbd6e7a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.223163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-4a109afb-25d2-42af-a46d-970dcbd6e7a3 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:27.224476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4a109afb-25d2-42af-a46d-970dcbd6e7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:27.242979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 935/1851] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:27.246954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a45cf-9b69-425f-b43c-6297c61d403c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:27.287975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 917/1852] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:27.297630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a109afb-25d2-42af-a46d-970dcbd6e7a3 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:27.300470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4a109afb-25d2-42af-a46d-970dcbd6e7a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:27.310624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a45cf-9b69-425f-b43c-6297c61d403c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:27.316019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c313-8303-423b-82f9-fbe3c390aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:27.316655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c313-8303-423b-82f9-fbe3c390aea5 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.316936 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c313-8303-423b-82f9-fbe3c390aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.317210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f7c313-8303-423b-82f9-fbe3c390aea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.317831 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7c313-8303-423b-82f9-fbe3c390aea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:27.319737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f7c313-8303-423b-82f9-fbe3c390aea5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:27.361172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a109afb-25d2-42af-a46d-970dcbd6e7a3 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:27.366675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab95f71-9461-415b-9d39-499c48610134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:27.367304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab95f71-9461-415b-9d39-499c48610134 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.367611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab95f71-9461-415b-9d39-499c48610134 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.368015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab95f71-9461-415b-9d39-499c48610134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.379821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab95f71-9461-415b-9d39-499c48610134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:27.381333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab95f71-9461-415b-9d39-499c48610134 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:27.392038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 918/1853] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:27.392783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab95f71-9461-415b-9d39-499c48610134 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:27.394060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8ab95f71-9461-415b-9d39-499c48610134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:27.406453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab95f71-9461-415b-9d39-499c48610134 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:27.413500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:27.414177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.414457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.414756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] PATH_INFO: `/v3/projects/70d1f765d25f4aec9aa8dcc83042ff7b` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.416183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=70d1f765d25f4aec9aa8dcc83042ff7b)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:27.418811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:27.506486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 936/1854] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:27 2022] POST /identity/v3/projects => generated 381 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:27.509277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c313-8303-423b-82f9-fbe3c390aea5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:27.579532 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f7c313-8303-423b-82f9-fbe3c390aea5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:27.587089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c9175-0888-40f6-b1a1-0039496de5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:27.588198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c9175-0888-40f6-b1a1-0039496de5ae admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.588622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c9175-0888-40f6-b1a1-0039496de5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.589044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765c9175-0888-40f6-b1a1-0039496de5ae admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.589885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c9175-0888-40f6-b1a1-0039496de5ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:27.592069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765c9175-0888-40f6-b1a1-0039496de5ae admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:27.676221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70d1f765d25f4aec9aa8dcc83042ff7b', 'request_id': 'req-cd91451f-7839-48cb-9cf7-15e175caba9c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:27.796870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 937/1855] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:27 2022] POST /identity/v3/users => generated 297 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:27.800875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c9175-0888-40f6-b1a1-0039496de5ae admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:27.810354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765c9175-0888-40f6-b1a1-0039496de5ae admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:27.870256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31b1b5-82d8-4366-aec4-bae154623426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:27.870857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31b1b5-82d8-4366-aec4-bae154623426 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.871138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31b1b5-82d8-4366-aec4-bae154623426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.871412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31b1b5-82d8-4366-aec4-bae154623426 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.872090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31b1b5-82d8-4366-aec4-bae154623426 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:27.873685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31b1b5-82d8-4366-aec4-bae154623426 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:27.883014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 938/1856] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:27.887185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31b1b5-82d8-4366-aec4-bae154623426 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:27.896882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31b1b5-82d8-4366-aec4-bae154623426 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:27.899033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70d1f765d25f4aec9aa8dcc83042ff7b', 'request_id': 'req-cd91451f-7839-48cb-9cf7-15e175caba9c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:27.902412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae7302-4867-4641-abe9-192aa05c0662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:27.903041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7302-4867-4641-abe9-192aa05c0662 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.903378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7302-4867-4641-abe9-192aa05c0662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.904248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae7302-4867-4641-abe9-192aa05c0662 admin admin] PATH_INFO: `/v3/projects/65f4bb25879b4e0f9faec707180e34e2/users/900e6bcc385e42d69da25196126679fd/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.907139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70d1f765d25f4aec9aa8dcc83042ff7b', 'request_id': 'req-cd91451f-7839-48cb-9cf7-15e175caba9c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:27.917522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] The token cache is being invalidate because project 70d1f765d25f4aec9aa8dcc83042ff7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:27.917965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:27.918586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:27.918957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae7302-4867-4641-abe9-192aa05c0662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f4bb25879b4e0f9faec707180e34e2, user_id=900e6bcc385e42d69da25196126679fd, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:27.920142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 919/1857] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:27 2022] DELETE /identity/v3/projects/70d1f765d25f4aec9aa8dcc83042ff7b => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:27.921965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae7302-4867-4641-abe9-192aa05c0662 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:27.923995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:27.925317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:27.938075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91451f-7839-48cb-9cf7-15e175caba9c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:27.942548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:27.943309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:27.943683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:27.944025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] PATH_INFO: `/v3/users/15e71050d1444ad9b8eb24ab79cf2922` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:27.945162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15e71050d1444ad9b8eb24ab79cf2922)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:27.947063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:28.077547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 939/1858] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:27 2022] PUT /identity/v3/projects/65f4bb25879b4e0f9faec707180e34e2/users/900e6bcc385e42d69da25196126679fd/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:28.080791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae7302-4867-4641-abe9-192aa05c0662 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:28.082706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-32ae7302-4867-4641-abe9-192aa05c0662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:28.146784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae7302-4867-4641-abe9-192aa05c0662 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:28.151450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa127085-8415-428f-a7a6-19b6065f472a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:28.152063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa127085-8415-428f-a7a6-19b6065f472a admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:28.152352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa127085-8415-428f-a7a6-19b6065f472a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:28.152628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa127085-8415-428f-a7a6-19b6065f472a admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:28.153269 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa127085-8415-428f-a7a6-19b6065f472a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:28.155524 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa127085-8415-428f-a7a6-19b6065f472a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:28.165820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 940/1859] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:28.170388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa127085-8415-428f-a7a6-19b6065f472a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:28.180243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa127085-8415-428f-a7a6-19b6065f472a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:28.185204 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa30e7e-6ae8-45fb-8053-fe9e97833b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:28.185856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa30e7e-6ae8-45fb-8053-fe9e97833b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:28.186137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa30e7e-6ae8-45fb-8053-fe9e97833b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:28.186411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa30e7e-6ae8-45fb-8053-fe9e97833b71 admin admin] PATH_INFO: `/v3/projects/65f4bb25879b4e0f9faec707180e34e2/users/900e6bcc385e42d69da25196126679fd/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:28.188580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa30e7e-6ae8-45fb-8053-fe9e97833b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65f4bb25879b4e0f9faec707180e34e2, user_id=900e6bcc385e42d69da25196126679fd, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:28.191295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa30e7e-6ae8-45fb-8053-fe9e97833b71 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:28.203391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 941/1860] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:28 2022] PUT /identity/v3/projects/65f4bb25879b4e0f9faec707180e34e2/users/900e6bcc385e42d69da25196126679fd/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:28.223420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca79c5-489f-4b9d-92a4-49683eeccf43 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:28.223748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca79c5-489f-4b9d-92a4-49683eeccf43 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:28.224147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca79c5-489f-4b9d-92a4-49683eeccf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:28.252332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-30ca79c5-489f-4b9d-92a4-49683eeccf43 None None] MFA Rules not processed for user `900e6bcc385e42d69da25196126679fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:28.253919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-30ca79c5-489f-4b9d-92a4-49683eeccf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:28.280872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15e71050d1444ad9b8eb24ab79cf2922'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:28.288531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15e71050d1444ad9b8eb24ab79cf2922'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:28.289423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15e71050d1444ad9b8eb24ab79cf2922'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:28.290055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15e71050d1444ad9b8eb24ab79cf2922'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:28.323852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 942/1861] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:28.336667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca79c5-489f-4b9d-92a4-49683eeccf43 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:28.338589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-30ca79c5-489f-4b9d-92a4-49683eeccf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:28.385242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15e71050d1444ad9b8eb24ab79cf2922'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:28.399611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca79c5-489f-4b9d-92a4-49683eeccf43 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:28.404892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 920/1862] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:27 2022] DELETE /identity/v3/users/15e71050d1444ad9b8eb24ab79cf2922 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:28.407911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d4177-bde1-4beb-9188-747688ad547f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:28.407911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d4177-bde1-4beb-9188-747688ad547f service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:28.407911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d4177-bde1-4beb-9188-747688ad547f service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:28.407911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d4177-bde1-4beb-9188-747688ad547f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:28.416735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d4177-bde1-4beb-9188-747688ad547f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:28.418172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62d4177-bde1-4beb-9188-747688ad547f service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:28.436928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 943/1863] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:29.120709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:29.122197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:29.198481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450df58d-be70-49ea-b84e-5a0d56367894 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:29.203170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:29.203846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:29.204129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:29.204402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] PATH_INFO: `/v3/projects/41b63b88e10e43a6abc73d1be6b5bb7d` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:29.205589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b63b88e10e43a6abc73d1be6b5bb7d)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:29.207502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:30.460452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b63b88e10e43a6abc73d1be6b5bb7d', 'request_id': 'req-fc356f00-23ab-49ab-baa5-6adf544d12d4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:30.531629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b1b28-2248-4ae2-b892-dbd929aae7d7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:30.532164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b1b28-2248-4ae2-b892-dbd929aae7d7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:30.532164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b1b28-2248-4ae2-b892-dbd929aae7d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:30.563085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8a6b1b28-2248-4ae2-b892-dbd929aae7d7 None None] MFA Rules not processed for user `b9835d2c0d204f6a94a8a0545647c9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:30.564385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8a6b1b28-2248-4ae2-b892-dbd929aae7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:30.642752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 944/1864] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:30.647072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b1b28-2248-4ae2-b892-dbd929aae7d7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:30.650258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8a6b1b28-2248-4ae2-b892-dbd929aae7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:30.722991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b1b28-2248-4ae2-b892-dbd929aae7d7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:30.727931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9314d48e-7f42-4f33-8e0c-8ef6f371c7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:30.741227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d48e-7f42-4f33-8e0c-8ef6f371c7d4 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:30.741227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d48e-7f42-4f33-8e0c-8ef6f371c7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:30.741227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9314d48e-7f42-4f33-8e0c-8ef6f371c7d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:30.741227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d48e-7f42-4f33-8e0c-8ef6f371c7d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:30.741227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9314d48e-7f42-4f33-8e0c-8ef6f371c7d4 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:30.820634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b63b88e10e43a6abc73d1be6b5bb7d', 'request_id': 'req-fc356f00-23ab-49ab-baa5-6adf544d12d4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:30.829794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b63b88e10e43a6abc73d1be6b5bb7d', 'request_id': 'req-fc356f00-23ab-49ab-baa5-6adf544d12d4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:30.852791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] The token cache is being invalidate because project 41b63b88e10e43a6abc73d1be6b5bb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:30.867211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:30.867211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:30.867211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 921/1865] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:29 2022] DELETE /identity/v3/projects/41b63b88e10e43a6abc73d1be6b5bb7d => generated 0 bytes in 1735 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:30.867633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 945/1866] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:30 2022] POST /identity/v3/projects => generated 371 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:30.870246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:30.870815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d8dc9-4dad-495d-904d-1d5072524f76 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:30.871111 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d8dc9-4dad-495d-904d-1d5072524f76 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:30.871390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d8dc9-4dad-495d-904d-1d5072524f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:30.871722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:30.885091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc356f00-23ab-49ab-baa5-6adf544d12d4 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:30.891691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8c9d8dc9-4dad-495d-904d-1d5072524f76 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:30.892958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8c9d8dc9-4dad-495d-904d-1d5072524f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:30.940523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8dbc0-282b-47e8-8558-f2883392fd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:30.941124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8dbc0-282b-47e8-8558-f2883392fd59 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:30.941401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8dbc0-282b-47e8-8558-f2883392fd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:30.941672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba8dbc0-282b-47e8-8558-f2883392fd59 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:30.942387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8dbc0-282b-47e8-8558-f2883392fd59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:30.944292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba8dbc0-282b-47e8-8558-f2883392fd59 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:30.951007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 946/1867] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:30.958568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb42d-5c43-432a-b251-17e007999081 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:30.958856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb42d-5c43-432a-b251-17e007999081 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:30.959134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ddb42d-5c43-432a-b251-17e007999081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:30.968815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:30.978834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-42ddb42d-5c43-432a-b251-17e007999081 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:30.980058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-42ddb42d-5c43-432a-b251-17e007999081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:30.988785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 947/1868] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:30.992825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb42d-5c43-432a-b251-17e007999081 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.002201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ddb42d-5c43-432a-b251-17e007999081 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.010565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517739-caef-4164-a42b-557b01c2d3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.010565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517739-caef-4164-a42b-557b01c2d3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.010565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517739-caef-4164-a42b-557b01c2d3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.010565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88517739-caef-4164-a42b-557b01c2d3f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.010919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517739-caef-4164-a42b-557b01c2d3f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:31.010919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517739-caef-4164-a42b-557b01c2d3f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.010919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88517739-caef-4164-a42b-557b01c2d3f5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.022016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 948/1869] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:52:31.026033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517739-caef-4164-a42b-557b01c2d3f5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.035870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88517739-caef-4164-a42b-557b01c2d3f5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.040579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5aebb-dc80-495c-ab20-277750c24291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.041247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5aebb-dc80-495c-ab20-277750c24291 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.043974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5aebb-dc80-495c-ab20-277750c24291 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.043974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5aebb-dc80-495c-ab20-277750c24291 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.043974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5aebb-dc80-495c-ab20-277750c24291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.046699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5aebb-dc80-495c-ab20-277750c24291 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.125030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 922/1870] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:30 2022] POST /identity/v3/users => generated 292 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:31.137587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8dbc0-282b-47e8-8558-f2883392fd59 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.151995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba8dbc0-282b-47e8-8558-f2883392fd59 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.157791 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8d03-0d31-432f-a7e5-a8621a959232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.158826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8d03-0d31-432f-a7e5-a8621a959232 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.159200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8d03-0d31-432f-a7e5-a8621a959232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.159577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d8d03-0d31-432f-a7e5-a8621a959232 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.160354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d8d03-0d31-432f-a7e5-a8621a959232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.162020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d8d03-0d31-432f-a7e5-a8621a959232 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.180521 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 923/1871] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:31.202946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 949/1872] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:31 2022] POST /identity/v3/projects => generated 367 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:31.210727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5aebb-dc80-495c-ab20-277750c24291 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.211554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8d03-0d31-432f-a7e5-a8621a959232 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.245115 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d8d03-0d31-432f-a7e5-a8621a959232 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.296760 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:31.336879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5aebb-dc80-495c-ab20-277750c24291 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.348748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df254e-8323-4fa0-bb11-fe9985d65df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.349546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df254e-8323-4fa0-bb11-fe9985d65df1 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.350456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df254e-8323-4fa0-bb11-fe9985d65df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.351768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df254e-8323-4fa0-bb11-fe9985d65df1 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.352668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df254e-8323-4fa0-bb11-fe9985d65df1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.357404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df254e-8323-4fa0-bb11-fe9985d65df1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.361797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6242a-bce6-43d5-82b5-2b88867b22e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.362731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6242a-bce6-43d5-82b5-2b88867b22e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.363060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6242a-bce6-43d5-82b5-2b88867b22e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.363374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6242a-bce6-43d5-82b5-2b88867b22e7 admin admin] PATH_INFO: `/v3/projects/7b0ff98c410f4a918513d21f063523b6/users/64b2c8cc38be45aeb2bcf26b90934847/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.385105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6242a-bce6-43d5-82b5-2b88867b22e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0ff98c410f4a918513d21f063523b6, user_id=64b2c8cc38be45aeb2bcf26b90934847, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.389073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6242a-bce6-43d5-82b5-2b88867b22e7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.479748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 950/1873] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:31 2022] POST /identity/v3/users => generated 284 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:31.480715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df254e-8323-4fa0-bb11-fe9985d65df1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.482534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e3df254e-8323-4fa0-bb11-fe9985d65df1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:31.546887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 924/1874] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:31 2022] PUT /identity/v3/projects/7b0ff98c410f4a918513d21f063523b6/users/64b2c8cc38be45aeb2bcf26b90934847/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:31.548345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6242a-bce6-43d5-82b5-2b88867b22e7 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.559091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df254e-8323-4fa0-bb11-fe9985d65df1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.620538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c013a-9057-4ed0-b11d-b95d3bb1c527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.621286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c013a-9057-4ed0-b11d-b95d3bb1c527 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.621573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c013a-9057-4ed0-b11d-b95d3bb1c527 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.621851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50c013a-9057-4ed0-b11d-b95d3bb1c527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.623677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b50c013a-9057-4ed0-b11d-b95d3bb1c527 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:31.641599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6242a-bce6-43d5-82b5-2b88867b22e7 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.647286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd42f4-827f-47c3-84f9-46eef6950baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.647927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd42f4-827f-47c3-84f9-46eef6950baf admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.648210 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd42f4-827f-47c3-84f9-46eef6950baf admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.648575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd42f4-827f-47c3-84f9-46eef6950baf admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.649227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd42f4-827f-47c3-84f9-46eef6950baf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.650885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd42f4-827f-47c3-84f9-46eef6950baf admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.665160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 925/1875] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:31.665160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd42f4-827f-47c3-84f9-46eef6950baf admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.675640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd42f4-827f-47c3-84f9-46eef6950baf admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.681496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044ced6-c7f3-4ca6-97ec-44348a9ca79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.682183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ced6-c7f3-4ca6-97ec-44348a9ca79d admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.682532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ced6-c7f3-4ca6-97ec-44348a9ca79d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.682879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d044ced6-c7f3-4ca6-97ec-44348a9ca79d admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.683568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044ced6-c7f3-4ca6-97ec-44348a9ca79d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.685777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d044ced6-c7f3-4ca6-97ec-44348a9ca79d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.696328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 926/1876] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:31.697158 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044ced6-c7f3-4ca6-97ec-44348a9ca79d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.701803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c013a-9057-4ed0-b11d-b95d3bb1c527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.703535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50c013a-9057-4ed0-b11d-b95d3bb1c527 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.708241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d044ced6-c7f3-4ca6-97ec-44348a9ca79d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.714824 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 951/1877] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:31.715528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c013a-9057-4ed0-b11d-b95d3bb1c527 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.720801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c47a7d-9606-4503-ba1d-fd3420a75250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.721429 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c47a7d-9606-4503-ba1d-fd3420a75250 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.721891 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c47a7d-9606-4503-ba1d-fd3420a75250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.722123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c47a7d-9606-4503-ba1d-fd3420a75250 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.722789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c47a7d-9606-4503-ba1d-fd3420a75250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.724529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c47a7d-9606-4503-ba1d-fd3420a75250 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.727714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50c013a-9057-4ed0-b11d-b95d3bb1c527 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.733235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ba8da-bbcb-49d4-8b1d-7fc55db91978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.734077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ba8da-bbcb-49d4-8b1d-7fc55db91978 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.734495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ba8da-bbcb-49d4-8b1d-7fc55db91978 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.734807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ba8da-bbcb-49d4-8b1d-7fc55db91978 admin admin] PATH_INFO: `/v3/projects/7b0ff98c410f4a918513d21f063523b6/users/64b2c8cc38be45aeb2bcf26b90934847/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.736756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ba8da-bbcb-49d4-8b1d-7fc55db91978 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0ff98c410f4a918513d21f063523b6, user_id=64b2c8cc38be45aeb2bcf26b90934847, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.738364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 927/1878] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:31.741372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ba8da-bbcb-49d4-8b1d-7fc55db91978 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.744535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c47a7d-9606-4503-ba1d-fd3420a75250 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:31.753136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 952/1879] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:31 2022] PUT /identity/v3/projects/7b0ff98c410f4a918513d21f063523b6/users/64b2c8cc38be45aeb2bcf26b90934847/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:31.755979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c47a7d-9606-4503-ba1d-fd3420a75250 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:31.843673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349a8cd-d4dc-4459-ab80-fc3a236ffff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:31.845104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349a8cd-d4dc-4459-ab80-fc3a236ffff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:31.845584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349a8cd-d4dc-4459-ab80-fc3a236ffff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:31.846013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c349a8cd-d4dc-4459-ab80-fc3a236ffff1 admin admin] PATH_INFO: `/v3/projects/632ce8016c784c679e7098257ffeca8d/users/fceecb8c249a43dfa7e41fe58633ab04/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:31.865168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349a8cd-d4dc-4459-ab80-fc3a236ffff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=632ce8016c784c679e7098257ffeca8d, user_id=fceecb8c249a43dfa7e41fe58633ab04, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:31.869322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c349a8cd-d4dc-4459-ab80-fc3a236ffff1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:31.989254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 928/1880] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:31 2022] PUT /identity/v3/projects/632ce8016c784c679e7098257ffeca8d/users/fceecb8c249a43dfa7e41fe58633ab04/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:32.001728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a15b-fac1-4a07-b63d-74564e1cdce0 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.002003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a15b-fac1-4a07-b63d-74564e1cdce0 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.002278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17a15b-fac1-4a07-b63d-74564e1cdce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.040849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-4b17a15b-fac1-4a07-b63d-74564e1cdce0 None None] MFA Rules not processed for user `fceecb8c249a43dfa7e41fe58633ab04`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:32.042215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4b17a15b-fac1-4a07-b63d-74564e1cdce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:32.111212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 953/1881] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:32.115892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349a8cd-d4dc-4459-ab80-fc3a236ffff1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:32.177639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c349a8cd-d4dc-4459-ab80-fc3a236ffff1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:32.182722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd8bd9-c943-4530-89ef-1b0a1bb9aec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:32.183474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8bd9-c943-4530-89ef-1b0a1bb9aec6 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.183790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8bd9-c943-4530-89ef-1b0a1bb9aec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.184069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd8bd9-c943-4530-89ef-1b0a1bb9aec6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.184744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd8bd9-c943-4530-89ef-1b0a1bb9aec6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:32.187215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd8bd9-c943-4530-89ef-1b0a1bb9aec6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:32.325792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17a15b-fac1-4a07-b63d-74564e1cdce0 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:32.328952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 929/1882] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:32 2022] POST /identity/v3/projects => generated 365 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:32.341489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17a15b-fac1-4a07-b63d-74564e1cdce0 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:32.425252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cebc3-06ff-4b06-9973-e0da76477091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:32.426638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cebc3-06ff-4b06-9973-e0da76477091 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.427035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cebc3-06ff-4b06-9973-e0da76477091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.427402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cebc3-06ff-4b06-9973-e0da76477091 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.430580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cebc3-06ff-4b06-9973-e0da76477091 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:32.435352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cebc3-06ff-4b06-9973-e0da76477091 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:32.600166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 954/1883] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:32 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:32.604410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd8bd9-c943-4530-89ef-1b0a1bb9aec6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:32.620550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd8bd9-c943-4530-89ef-1b0a1bb9aec6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:32.631798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f9c0-6d22-474c-b992-e016bee7c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:32.632683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f9c0-6d22-474c-b992-e016bee7c339 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.633027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f9c0-6d22-474c-b992-e016bee7c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.633400 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637f9c0-6d22-474c-b992-e016bee7c339 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.634131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f9c0-6d22-474c-b992-e016bee7c339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:32.636150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c637f9c0-6d22-474c-b992-e016bee7c339 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:32.648811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 930/1884] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:32.652884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cebc3-06ff-4b06-9973-e0da76477091 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:32.668938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cebc3-06ff-4b06-9973-e0da76477091 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:32.676013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eb9e5-1bd1-49b2-9972-34351fb07d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:32.677054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eb9e5-1bd1-49b2-9972-34351fb07d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.677637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eb9e5-1bd1-49b2-9972-34351fb07d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.678067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364eb9e5-1bd1-49b2-9972-34351fb07d82 admin admin] PATH_INFO: `/v3/projects/de6520894c674cd0b3c6d9b47e7e8078/users/9c39df65b9414d2e9774dc5cce37acb2/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.700766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eb9e5-1bd1-49b2-9972-34351fb07d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6520894c674cd0b3c6d9b47e7e8078, user_id=9c39df65b9414d2e9774dc5cce37acb2, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:32.705253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364eb9e5-1bd1-49b2-9972-34351fb07d82 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:32.837834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 955/1885] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:32 2022] PUT /identity/v3/projects/de6520894c674cd0b3c6d9b47e7e8078/users/9c39df65b9414d2e9774dc5cce37acb2/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:32.842293 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f9c0-6d22-474c-b992-e016bee7c339 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:32.852450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637f9c0-6d22-474c-b992-e016bee7c339 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:32.913449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f2739-979a-4a57-8b4e-385828857c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:32.914061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f2739-979a-4a57-8b4e-385828857c19 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.915003 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f2739-979a-4a57-8b4e-385828857c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.915282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f2739-979a-4a57-8b4e-385828857c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.916027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f2739-979a-4a57-8b4e-385828857c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:32.917622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f2739-979a-4a57-8b4e-385828857c19 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:32.927768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 931/1886] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:32.932029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eb9e5-1bd1-49b2-9972-34351fb07d82 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:32.942957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364eb9e5-1bd1-49b2-9972-34351fb07d82 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:32.949694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a97d0-1081-438e-95dd-a7873f31c9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:32.951390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a97d0-1081-438e-95dd-a7873f31c9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.951870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a97d0-1081-438e-95dd-a7873f31c9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.952221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87a97d0-1081-438e-95dd-a7873f31c9ae admin admin] PATH_INFO: `/v3/projects/de6520894c674cd0b3c6d9b47e7e8078/users/9c39df65b9414d2e9774dc5cce37acb2/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:32.954279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a97d0-1081-438e-95dd-a7873f31c9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=de6520894c674cd0b3c6d9b47e7e8078, user_id=9c39df65b9414d2e9774dc5cce37acb2, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:32.957307 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87a97d0-1081-438e-95dd-a7873f31c9ae admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:32.969567 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 956/1887] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:32 2022] PUT /identity/v3/projects/de6520894c674cd0b3c6d9b47e7e8078/users/9c39df65b9414d2e9774dc5cce37acb2/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:32.988692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6e079-29ff-434c-8481-6e1a3ab075c2 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:32.988692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6e079-29ff-434c-8481-6e1a3ab075c2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:32.988692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6e079-29ff-434c-8481-6e1a3ab075c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.017931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-d3b6e079-29ff-434c-8481-6e1a3ab075c2 None None] MFA Rules not processed for user `9c39df65b9414d2e9774dc5cce37acb2`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:33.019221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d3b6e079-29ff-434c-8481-6e1a3ab075c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:33.099343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 932/1888] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:32 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:33.108325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a97d0-1081-438e-95dd-a7873f31c9ae admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:33.171595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87a97d0-1081-438e-95dd-a7873f31c9ae admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:33.175140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48795eed-a0f7-4e16-a4cf-cee00c3804e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:33.175777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48795eed-a0f7-4e16-a4cf-cee00c3804e7 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:33.176061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48795eed-a0f7-4e16-a4cf-cee00c3804e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:33.176338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48795eed-a0f7-4e16-a4cf-cee00c3804e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.185642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48795eed-a0f7-4e16-a4cf-cee00c3804e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:33.187068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48795eed-a0f7-4e16-a4cf-cee00c3804e7 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:33.196844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 957/1889] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:33.484365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6e079-29ff-434c-8481-6e1a3ab075c2 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:33.509865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a089c-0cc5-4c39-b9b7-402937600ee6 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:33.510159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a089c-0cc5-4c39-b9b7-402937600ee6 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:33.510437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a089c-0cc5-4c39-b9b7-402937600ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.512940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6e079-29ff-434c-8481-6e1a3ab075c2 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:33.524251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771ee3d-23fa-4426-87fe-06d74dcff1bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:33.524930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ee3d-23fa-4426-87fe-06d74dcff1bf service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:33.544806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ee3d-23fa-4426-87fe-06d74dcff1bf service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:33.545107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771ee3d-23fa-4426-87fe-06d74dcff1bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.581286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ef5a089c-0cc5-4c39-b9b7-402937600ee6 None None] MFA Rules not processed for user `64b2c8cc38be45aeb2bcf26b90934847`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:33.582558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ef5a089c-0cc5-4c39-b9b7-402937600ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:33.652645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771ee3d-23fa-4426-87fe-06d74dcff1bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:33.655200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771ee3d-23fa-4426-87fe-06d74dcff1bf service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:33.671656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 933/1890] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:33.684678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 958/1891] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:33.696144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb29cfa-d164-436e-a2ff-59ca85f8abff None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:33.696437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb29cfa-d164-436e-a2ff-59ca85f8abff None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:33.696721 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb29cfa-d164-436e-a2ff-59ca85f8abff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.724380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-cdb29cfa-d164-436e-a2ff-59ca85f8abff None None] MFA Rules not processed for user `b9835d2c0d204f6a94a8a0545647c9bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:33.725657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cdb29cfa-d164-436e-a2ff-59ca85f8abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:33.787457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 934/1892] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:33.796847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a089c-0cc5-4c39-b9b7-402937600ee6 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:33.798310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ef5a089c-0cc5-4c39-b9b7-402937600ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:33.881348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a089c-0cc5-4c39-b9b7-402937600ee6 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:33.887542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be2873-a2ed-4adc-bc31-cf17667ac874 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:33.889237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be2873-a2ed-4adc-bc31-cf17667ac874 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:33.889524 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be2873-a2ed-4adc-bc31-cf17667ac874 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:33.889807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be2873-a2ed-4adc-bc31-cf17667ac874 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:33.891612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-10be2873-a2ed-4adc-bc31-cf17667ac874 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:33.904208 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be2873-a2ed-4adc-bc31-cf17667ac874 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:33.905890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be2873-a2ed-4adc-bc31-cf17667ac874 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:33.925606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 959/1893] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:34.203263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:35.303232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7436c-e4cf-4ea6-9e79-d7fb72e52791 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.303729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7436c-e4cf-4ea6-9e79-d7fb72e52791 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.303984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7436c-e4cf-4ea6-9e79-d7fb72e52791 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.305785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 935/1894] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:52:35.314844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0ced3-489e-4a57-81f4-d82171fa8ebf None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.315318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0ced3-489e-4a57-81f4-d82171fa8ebf None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.316063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e0ced3-489e-4a57-81f4-d82171fa8ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.337876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-54e0ced3-489e-4a57-81f4-d82171fa8ebf None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:35.339681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-54e0ced3-489e-4a57-81f4-d82171fa8ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:35.355991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 960/1895] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:52:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:35.368959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7436c-e4cf-4ea6-9e79-d7fb72e52791 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:35.384310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b7436c-e4cf-4ea6-9e79-d7fb72e52791 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:35.394329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bb89e-43f1-410f-883f-c84d34a58e3e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:35.394329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bb89e-43f1-410f-883f-c84d34a58e3e service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:35.394329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bb89e-43f1-410f-883f-c84d34a58e3e service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:35.394329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bb89e-43f1-410f-883f-c84d34a58e3e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:35.403342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bb89e-43f1-410f-883f-c84d34a58e3e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:35.405576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524bb89e-43f1-410f-883f-c84d34a58e3e service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:35.416589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 936/1896] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:35.468961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:36.831163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:37.429700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0ced3-489e-4a57-81f4-d82171fa8ebf None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:37.431262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-54e0ced3-489e-4a57-81f4-d82171fa8ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:37.442888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e0ced3-489e-4a57-81f4-d82171fa8ebf None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:37.446692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:37.447445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:37.447863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:37.448352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:37.450336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:37.545544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:37.547135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:37.559015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 961/1897] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:38.906014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:41.016927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:42.165978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:43.113879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bb89e-43f1-410f-883f-c84d34a58e3e service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.181683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.183156 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:43.245367 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bb89e-43f1-410f-883f-c84d34a58e3e service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.253218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:43.254256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.254637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.255294 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] PATH_INFO: `/v3/users/fceecb8c249a43dfa7e41fe58633ab04` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.256617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fceecb8c249a43dfa7e41fe58633ab04)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:43.259927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:43.308698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3cb588-ae18-47b3-9db9-d084ad698be2 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.314093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:43.314761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.315039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.315311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] PATH_INFO: `/v3/users/ace6f4d34f9e4ffdb5f571520f43802b` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.316464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ace6f4d34f9e4ffdb5f571520f43802b)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:43.319111 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:43.538369 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fceecb8c249a43dfa7e41fe58633ab04'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.546730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fceecb8c249a43dfa7e41fe58633ab04'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.547647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fceecb8c249a43dfa7e41fe58633ab04'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.548601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fceecb8c249a43dfa7e41fe58633ab04'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.659679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ace6f4d34f9e4ffdb5f571520f43802b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.669016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ace6f4d34f9e4ffdb5f571520f43802b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.670474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ace6f4d34f9e4ffdb5f571520f43802b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.671300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ace6f4d34f9e4ffdb5f571520f43802b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.678958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7c8f1434-58fb-43df-9ca0-2aad26975332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fceecb8c249a43dfa7e41fe58633ab04'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.707862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 937/1898] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:43 2022] DELETE /identity/v3/users/fceecb8c249a43dfa7e41fe58633ab04 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:43.712408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb2e49-ed71-49b9-b7d0-69e9606485ea None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.713444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb2e49-ed71-49b9-b7d0-69e9606485ea None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.723684 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb2e49-ed71-49b9-b7d0-69e9606485ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.762023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-cfcb2e49-ed71-49b9-b7d0-69e9606485ea None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:43.763958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cfcb2e49-ed71-49b9-b7d0-69e9606485ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:43.831876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 938/1899] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:43.847455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb2e49-ed71-49b9-b7d0-69e9606485ea None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:43.849084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cfcb2e49-ed71-49b9-b7d0-69e9606485ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:43.894452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-29e3dfad-90f2-4b0f-b545-f92116bad11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ace6f4d34f9e4ffdb5f571520f43802b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:43.921123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 962/1900] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:43 2022] DELETE /identity/v3/users/ace6f4d34f9e4ffdb5f571520f43802b => generated 0 bytes in 740 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:43.925714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf7de-c62f-41d8-9b97-19098101f5a7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:43.925998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf7de-c62f-41d8-9b97-19098101f5a7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:43.927659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faf7de-c62f-41d8-9b97-19098101f5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:43.942111 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb2e49-ed71-49b9-b7d0-69e9606485ea None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:43.953023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d5faf7de-c62f-41d8-9b97-19098101f5a7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:43.954389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d5faf7de-c62f-41d8-9b97-19098101f5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:44.010794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e00e1-1f8f-4291-820d-39a1e67d4f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:44.011425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e00e1-1f8f-4291-820d-39a1e67d4f7e service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:44.011762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e00e1-1f8f-4291-820d-39a1e67d4f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:44.012036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e00e1-1f8f-4291-820d-39a1e67d4f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:44.045859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 963/1901] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:44.075338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf7de-c62f-41d8-9b97-19098101f5a7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:44.090999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5faf7de-c62f-41d8-9b97-19098101f5a7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:44.098540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e00e1-1f8f-4291-820d-39a1e67d4f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:44.111627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4351-df50-49ec-aeae-536d55fa6dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:44.111627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4351-df50-49ec-aeae-536d55fa6dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:44.111627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4351-df50-49ec-aeae-536d55fa6dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:44.111627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ee4351-df50-49ec-aeae-536d55fa6dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:44.112269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e00e1-1f8f-4291-820d-39a1e67d4f7e service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:44.120060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee4351-df50-49ec-aeae-536d55fa6dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:44.121514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ee4351-df50-49ec-aeae-536d55fa6dc5 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:44.134631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 964/1902] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:44.136974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 939/1903] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:45.185898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4351-df50-49ec-aeae-536d55fa6dc5 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:45.187594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-21ee4351-df50-49ec-aeae-536d55fa6dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:45.200419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ee4351-df50-49ec-aeae-536d55fa6dc5 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:45.210919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:45.212051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:45.212516 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:45.212931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] PATH_INFO: `/v3/projects/1e927cb4d91c4a23b7318a6048ae03b7` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:45.215483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e927cb4d91c4a23b7318a6048ae03b7)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:45.225295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:45.276383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e00e1-1f8f-4291-820d-39a1e67d4f7e service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:45.278260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fd1e00e1-1f8f-4291-820d-39a1e67d4f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:45.298209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e00e1-1f8f-4291-820d-39a1e67d4f7e service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:45.319914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:45.319914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:45.319914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:45.319914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] PATH_INFO: `/v3/projects/632ce8016c784c679e7098257ffeca8d` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:45.322331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=632ce8016c784c679e7098257ffeca8d)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:45.324939 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:45.454819 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:45.517883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e927cb4d91c4a23b7318a6048ae03b7', 'request_id': 'req-c8df5e0e-a657-461f-957d-fa1925d15de2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.549798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '632ce8016c784c679e7098257ffeca8d', 'request_id': 'req-cbba3ceb-2d96-4dfe-a5cf-803f68951426'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.637428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e927cb4d91c4a23b7318a6048ae03b7', 'request_id': 'req-c8df5e0e-a657-461f-957d-fa1925d15de2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.649410 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e927cb4d91c4a23b7318a6048ae03b7', 'request_id': 'req-c8df5e0e-a657-461f-957d-fa1925d15de2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.661852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] The token cache is being invalidate because project 1e927cb4d91c4a23b7318a6048ae03b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:45.662139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.663069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.664915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 965/1904] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:45 2022] DELETE /identity/v3/projects/1e927cb4d91c4a23b7318a6048ae03b7 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:45.668697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:45.670712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:45.742759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df5e0e-a657-461f-957d-fa1925d15de2 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:45.809826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '632ce8016c784c679e7098257ffeca8d', 'request_id': 'req-cbba3ceb-2d96-4dfe-a5cf-803f68951426'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.820044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '632ce8016c784c679e7098257ffeca8d', 'request_id': 'req-cbba3ceb-2d96-4dfe-a5cf-803f68951426'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.844090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] The token cache is being invalidate because project 632ce8016c784c679e7098257ffeca8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:45.844298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.847049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:45.849037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 940/1905] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:45 2022] DELETE /identity/v3/projects/632ce8016c784c679e7098257ffeca8d => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:45.853727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:45.862096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:45.862096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:45.862404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:45.862482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] PATH_INFO: `/v3/users/e921bebba8c34dfcbd3683552a6b3a25` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:45.862482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] RBAC: Authorizing `identity:delete_user(user_id=e921bebba8c34dfcbd3683552a6b3a25)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:45.862625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:45.862693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:45.882935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba3ceb-2d96-4dfe-a5cf-803f68951426 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:45.891676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:45.894718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:45.896562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:45.896562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] PATH_INFO: `/v3/users/9c39df65b9414d2e9774dc5cce37acb2` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:45.900910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c39df65b9414d2e9774dc5cce37acb2)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:45.907108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:45.917802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:46.145519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e921bebba8c34dfcbd3683552a6b3a25'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.152662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e921bebba8c34dfcbd3683552a6b3a25'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.153356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e921bebba8c34dfcbd3683552a6b3a25'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.154626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e921bebba8c34dfcbd3683552a6b3a25'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.240355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c39df65b9414d2e9774dc5cce37acb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.249060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c39df65b9414d2e9774dc5cce37acb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.249921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c39df65b9414d2e9774dc5cce37acb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.250588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c39df65b9414d2e9774dc5cce37acb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.254078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e921bebba8c34dfcbd3683552a6b3a25'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.276710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 966/1906] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:45 2022] DELETE /identity/v3/users/e921bebba8c34dfcbd3683552a6b3a25 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:46.361560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c39df65b9414d2e9774dc5cce37acb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:46.410186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 941/1907] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:45 2022] DELETE /identity/v3/users/9c39df65b9414d2e9774dc5cce37acb2 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:46.979251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:46.982815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:47.086833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276a6c48-cfad-49d1-b74a-07929171face admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:47.165161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:47.166548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:47.167038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:47.167540 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] PATH_INFO: `/v3/projects/a7447ace48c8401faf70af01d2771df2` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:47.168987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7447ace48c8401faf70af01d2771df2)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:47.172305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:47.318909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:47.320969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:47.336549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7447ace48c8401faf70af01d2771df2', 'request_id': 'req-8e36ea37-0045-4816-924c-d879f39c150a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.356812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f95766-920d-4ef5-8095-9429c4d400f5 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:47.421156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:47.422566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:47.422849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:47.423126 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] PATH_INFO: `/v3/projects/de6520894c674cd0b3c6d9b47e7e8078` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:47.424353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de6520894c674cd0b3c6d9b47e7e8078)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:47.426299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:47.466938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7447ace48c8401faf70af01d2771df2', 'request_id': 'req-8e36ea37-0045-4816-924c-d879f39c150a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.466938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7447ace48c8401faf70af01d2771df2', 'request_id': 'req-8e36ea37-0045-4816-924c-d879f39c150a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.470123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] The token cache is being invalidate because project a7447ace48c8401faf70af01d2771df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:47.470456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.471105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.472739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 967/1908] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:46 2022] DELETE /identity/v3/projects/a7447ace48c8401faf70af01d2771df2 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:47.476439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:47.477818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:47.490809 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e36ea37-0045-4816-924c-d879f39c150a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:47.495530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:47.496232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:47.496516 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:47.496794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] PATH_INFO: `/v3/users/900e6bcc385e42d69da25196126679fd` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:47.498702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900e6bcc385e42d69da25196126679fd)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:47.500699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:47.574885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de6520894c674cd0b3c6d9b47e7e8078', 'request_id': 'req-51de3171-e213-4052-bd61-6a7fd1d40861'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.731884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de6520894c674cd0b3c6d9b47e7e8078', 'request_id': 'req-51de3171-e213-4052-bd61-6a7fd1d40861'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.742120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de6520894c674cd0b3c6d9b47e7e8078', 'request_id': 'req-51de3171-e213-4052-bd61-6a7fd1d40861'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.757208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] The token cache is being invalidate because project de6520894c674cd0b3c6d9b47e7e8078 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:47.757354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.758265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-51de3171-e213-4052-bd61-6a7fd1d40861 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.764652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 942/1909] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:47 2022] DELETE /identity/v3/projects/de6520894c674cd0b3c6d9b47e7e8078 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:47.766673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735100-d861-48ec-8975-96275ad4b6bb None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:47.767171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735100-d861-48ec-8975-96275ad4b6bb None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:47.767654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81735100-d861-48ec-8975-96275ad4b6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:47.800005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-81735100-d861-48ec-8975-96275ad4b6bb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:47.801324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-81735100-d861-48ec-8975-96275ad4b6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:47.853667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900e6bcc385e42d69da25196126679fd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.868202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900e6bcc385e42d69da25196126679fd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.868956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900e6bcc385e42d69da25196126679fd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.869695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900e6bcc385e42d69da25196126679fd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.905673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 943/1910] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:47.913789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a45b0-9d6d-4d5c-be4f-19166cab7637 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:47.914079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a45b0-9d6d-4d5c-be4f-19166cab7637 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:47.914355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a45b0-9d6d-4d5c-be4f-19166cab7637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:47.934437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a18a45b0-9d6d-4d5c-be4f-19166cab7637 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:47.936435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a18a45b0-9d6d-4d5c-be4f-19166cab7637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:47.948013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 944/1911] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:47.952741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a45b0-9d6d-4d5c-be4f-19166cab7637 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:47.963853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a45b0-9d6d-4d5c-be4f-19166cab7637 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:47.969588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55658b-ca38-418f-b847-7dcf0aed7525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:47.969972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55658b-ca38-418f-b847-7dcf0aed7525 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:47.970315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55658b-ca38-418f-b847-7dcf0aed7525 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:47.970593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55658b-ca38-418f-b847-7dcf0aed7525 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:47.971252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55658b-ca38-418f-b847-7dcf0aed7525 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:47.971625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55658b-ca38-418f-b847-7dcf0aed7525 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:47.973676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55658b-ca38-418f-b847-7dcf0aed7525 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:47.980062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900e6bcc385e42d69da25196126679fd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:47.991549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 945/1912] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:47.997761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55658b-ca38-418f-b847-7dcf0aed7525 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:48.010621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 968/1913] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:47 2022] DELETE /identity/v3/users/900e6bcc385e42d69da25196126679fd => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:48.011266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55658b-ca38-418f-b847-7dcf0aed7525 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:48.070612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558f6b6-e629-41fc-b7f7-6e1f43c32cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:48.071440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558f6b6-e629-41fc-b7f7-6e1f43c32cce admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:48.071750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558f6b6-e629-41fc-b7f7-6e1f43c32cce admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:48.072021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f558f6b6-e629-41fc-b7f7-6e1f43c32cce admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:48.072653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558f6b6-e629-41fc-b7f7-6e1f43c32cce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:48.074530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f558f6b6-e629-41fc-b7f7-6e1f43c32cce admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:48.205624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 946/1914] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:47 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:48.211031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:48.228680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5557c4a6-ba1c-45b2-a271-00c561522a52 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:48.332213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343e18e-a21c-476c-9e30-4e6145f525a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:48.332852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343e18e-a21c-476c-9e30-4e6145f525a7 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:48.333138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343e18e-a21c-476c-9e30-4e6145f525a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:48.333423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343e18e-a21c-476c-9e30-4e6145f525a7 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:48.334075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343e18e-a21c-476c-9e30-4e6145f525a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:48.336113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343e18e-a21c-476c-9e30-4e6145f525a7 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:48.499164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 969/1915] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:48 2022] POST /identity/v3/users => generated 294 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:48.515603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558f6b6-e629-41fc-b7f7-6e1f43c32cce admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:48.526114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f558f6b6-e629-41fc-b7f7-6e1f43c32cce admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:48.531660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674e512-2485-43ec-a93b-361596aa2268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:48.532280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674e512-2485-43ec-a93b-361596aa2268 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:48.532569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674e512-2485-43ec-a93b-361596aa2268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:48.532875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1674e512-2485-43ec-a93b-361596aa2268 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:48.533531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674e512-2485-43ec-a93b-361596aa2268 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:48.535134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1674e512-2485-43ec-a93b-361596aa2268 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:48.546104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 947/1916] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:48.553525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343e18e-a21c-476c-9e30-4e6145f525a7 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:48.563849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343e18e-a21c-476c-9e30-4e6145f525a7 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:48.568491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81887-ba58-4eb7-878e-04e054d85c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:48.569110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81887-ba58-4eb7-878e-04e054d85c24 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:48.569388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81887-ba58-4eb7-878e-04e054d85c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:48.569659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d81887-ba58-4eb7-878e-04e054d85c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:48.570322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d81887-ba58-4eb7-878e-04e054d85c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:48.572186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d81887-ba58-4eb7-878e-04e054d85c24 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:48.582760 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 970/1917] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:48.593139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674e512-2485-43ec-a93b-361596aa2268 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:48.603216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1674e512-2485-43ec-a93b-361596aa2268 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:48.607774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97a094c-2b3e-486c-b78d-ca84c21db9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:48.608454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a094c-2b3e-486c-b78d-ca84c21db9ca admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:48.608735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a094c-2b3e-486c-b78d-ca84c21db9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:48.609011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a094c-2b3e-486c-b78d-ca84c21db9ca admin admin] PATH_INFO: `/v3/projects/bee3a4f2a49042b988bcd0418bd1c4ee/users/4c07cbc1907c43fc889a8753f7c90b28/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:48.623940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a094c-2b3e-486c-b78d-ca84c21db9ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=bee3a4f2a49042b988bcd0418bd1c4ee, user_id=4c07cbc1907c43fc889a8753f7c90b28, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:48.626564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97a094c-2b3e-486c-b78d-ca84c21db9ca admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:48.647541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81887-ba58-4eb7-878e-04e054d85c24 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:48.649263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-00d81887-ba58-4eb7-878e-04e054d85c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:48.662447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d81887-ba58-4eb7-878e-04e054d85c24 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:48.667231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:48.667914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:48.668203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:48.671134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] PATH_INFO: `/v3/projects/65f4bb25879b4e0f9faec707180e34e2` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:48.671134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65f4bb25879b4e0f9faec707180e34e2)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:48.672159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:48.773553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 948/1918] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:48 2022] PUT /identity/v3/projects/bee3a4f2a49042b988bcd0418bd1c4ee/users/4c07cbc1907c43fc889a8753f7c90b28/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:48.785089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134cffc-fbd9-44bb-8783-b44e83d61b2b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:48.785381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134cffc-fbd9-44bb-8783-b44e83d61b2b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:48.785658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134cffc-fbd9-44bb-8783-b44e83d61b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:48.817507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a134cffc-fbd9-44bb-8783-b44e83d61b2b None None] MFA Rules not processed for user `4c07cbc1907c43fc889a8753f7c90b28`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:48.818705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a134cffc-fbd9-44bb-8783-b44e83d61b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:48.881732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 949/1919] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:48.886353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134cffc-fbd9-44bb-8783-b44e83d61b2b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:48.924858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65f4bb25879b4e0f9faec707180e34e2', 'request_id': 'req-8afeda51-a4e4-4953-9d36-e3bb42405212'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:48.954095 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134cffc-fbd9-44bb-8783-b44e83d61b2b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.012880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139418-2fa1-491d-adb0-8fd12fd550c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.013518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139418-2fa1-491d-adb0-8fd12fd550c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.013804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139418-2fa1-491d-adb0-8fd12fd550c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.014074 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22139418-2fa1-491d-adb0-8fd12fd550c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.014722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139418-2fa1-491d-adb0-8fd12fd550c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.016650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22139418-2fa1-491d-adb0-8fd12fd550c1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.023074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65f4bb25879b4e0f9faec707180e34e2', 'request_id': 'req-8afeda51-a4e4-4953-9d36-e3bb42405212'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:49.031019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65f4bb25879b4e0f9faec707180e34e2', 'request_id': 'req-8afeda51-a4e4-4953-9d36-e3bb42405212'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:49.044534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] The token cache is being invalidate because project 65f4bb25879b4e0f9faec707180e34e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:49.045554 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:49.046355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8afeda51-a4e4-4953-9d36-e3bb42405212 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:49.048109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 971/1920] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:48 2022] DELETE /identity/v3/projects/65f4bb25879b4e0f9faec707180e34e2 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:49.054051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfb3af-4525-4793-94e4-b15a4a28035e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.054337 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfb3af-4525-4793-94e4-b15a4a28035e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.054609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cfb3af-4525-4793-94e4-b15a4a28035e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.075112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-86cfb3af-4525-4793-94e4-b15a4a28035e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:49.076393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-86cfb3af-4525-4793-94e4-b15a4a28035e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:49.084223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 972/1921] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:49.094453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30fac-6760-437a-b8aa-aa26f5558342 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.094742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30fac-6760-437a-b8aa-aa26f5558342 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.095058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f30fac-6760-437a-b8aa-aa26f5558342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.115493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-07f30fac-6760-437a-b8aa-aa26f5558342 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:49.116759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-07f30fac-6760-437a-b8aa-aa26f5558342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:49.118867 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 950/1922] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:48 2022] POST /identity/v3/projects => generated 385 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:49.123303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139418-2fa1-491d-adb0-8fd12fd550c1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.125179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-22139418-2fa1-491d-adb0-8fd12fd550c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:49.179809 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 973/1923] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:49.184147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30fac-6760-437a-b8aa-aa26f5558342 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.188393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22139418-2fa1-491d-adb0-8fd12fd550c1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.192974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f30fac-6760-437a-b8aa-aa26f5558342 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.193693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a1c27-aab3-4cbb-a660-7a11db4a44f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.194303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a1c27-aab3-4cbb-a660-7a11db4a44f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.194580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a1c27-aab3-4cbb-a660-7a11db4a44f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.194851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395a1c27-aab3-4cbb-a660-7a11db4a44f9 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.195560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a1c27-aab3-4cbb-a660-7a11db4a44f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.197454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395a1c27-aab3-4cbb-a660-7a11db4a44f9 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.200923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe42a3-ba3a-4040-882a-2e4f54ea625f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.200923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe42a3-ba3a-4040-882a-2e4f54ea625f admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.200923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe42a3-ba3a-4040-882a-2e4f54ea625f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.200923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe42a3-ba3a-4040-882a-2e4f54ea625f admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.201238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe42a3-ba3a-4040-882a-2e4f54ea625f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:49.201238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe42a3-ba3a-4040-882a-2e4f54ea625f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.201382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe42a3-ba3a-4040-882a-2e4f54ea625f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.212851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 974/1924] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:49.217893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe42a3-ba3a-4040-882a-2e4f54ea625f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.227282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe42a3-ba3a-4040-882a-2e4f54ea625f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.232842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e3780-d1c5-48e1-a396-4a1d3e597593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.233293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3780-d1c5-48e1-a396-4a1d3e597593 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.233569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3780-d1c5-48e1-a396-4a1d3e597593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.233834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e3780-d1c5-48e1-a396-4a1d3e597593 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.234447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e3780-d1c5-48e1-a396-4a1d3e597593 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.236361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e3780-d1c5-48e1-a396-4a1d3e597593 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.337506 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 951/1925] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:49 2022] POST /identity/v3/users => generated 299 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:49.342476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a1c27-aab3-4cbb-a660-7a11db4a44f9 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.353065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395a1c27-aab3-4cbb-a660-7a11db4a44f9 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.358160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb88b4e-6701-4c8b-9546-630375ef2475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.358817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb88b4e-6701-4c8b-9546-630375ef2475 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.359119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb88b4e-6701-4c8b-9546-630375ef2475 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.359385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb88b4e-6701-4c8b-9546-630375ef2475 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.360068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb88b4e-6701-4c8b-9546-630375ef2475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.361665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb88b4e-6701-4c8b-9546-630375ef2475 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.376005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 975/1926] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:49 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:52:49.378835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 952/1927] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:49.382300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb88b4e-6701-4c8b-9546-630375ef2475 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.382757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e3780-d1c5-48e1-a396-4a1d3e597593 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.394220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb88b4e-6701-4c8b-9546-630375ef2475 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.458080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78083b81-857e-4eb9-994c-cb9bf6fe093d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.458946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083b81-857e-4eb9-994c-cb9bf6fe093d admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.459225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083b81-857e-4eb9-994c-cb9bf6fe093d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.459499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78083b81-857e-4eb9-994c-cb9bf6fe093d admin admin] PATH_INFO: `/v3/projects/a9cf5d13ddd047f788e918d9b1c67f7b/users/14e459bbc0064fac872e4444bff7d3de/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.461436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e3780-d1c5-48e1-a396-4a1d3e597593 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.467269 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ef8d-4305-4d4a-ae6d-db1a14b8b020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.467987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ef8d-4305-4d4a-ae6d-db1a14b8b020 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.468374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ef8d-4305-4d4a-ae6d-db1a14b8b020 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.468710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f0ef8d-4305-4d4a-ae6d-db1a14b8b020 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.469414 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0ef8d-4305-4d4a-ae6d-db1a14b8b020 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.471466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f0ef8d-4305-4d4a-ae6d-db1a14b8b020 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.474794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78083b81-857e-4eb9-994c-cb9bf6fe093d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cf5d13ddd047f788e918d9b1c67f7b, user_id=14e459bbc0064fac872e4444bff7d3de, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.477538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78083b81-857e-4eb9-994c-cb9bf6fe093d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.570929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 953/1928] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:49 2022] PUT /identity/v3/projects/a9cf5d13ddd047f788e918d9b1c67f7b/users/14e459bbc0064fac872e4444bff7d3de/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:49.574965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78083b81-857e-4eb9-994c-cb9bf6fe093d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.631825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 976/1929] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:49 2022] POST /identity/v3/users => generated 285 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:49.635837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ef8d-4305-4d4a-ae6d-db1a14b8b020 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.642593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78083b81-857e-4eb9-994c-cb9bf6fe093d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.647743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933e417-4c84-48f0-b8a8-3a3817564250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.648089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f0ef8d-4305-4d4a-ae6d-db1a14b8b020 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.648578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e417-4c84-48f0-b8a8-3a3817564250 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.648960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e417-4c84-48f0-b8a8-3a3817564250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.649650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4933e417-4c84-48f0-b8a8-3a3817564250 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.650410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933e417-4c84-48f0-b8a8-3a3817564250 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.652099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4933e417-4c84-48f0-b8a8-3a3817564250 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.653073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59355c2-1ac6-4b38-9585-f3d299010a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.656996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59355c2-1ac6-4b38-9585-f3d299010a8d admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.656996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59355c2-1ac6-4b38-9585-f3d299010a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.656996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59355c2-1ac6-4b38-9585-f3d299010a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.656996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59355c2-1ac6-4b38-9585-f3d299010a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.657902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59355c2-1ac6-4b38-9585-f3d299010a8d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.661746 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:49.664634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 954/1930] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:49.669517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933e417-4c84-48f0-b8a8-3a3817564250 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.673563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 977/1931] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:49.677947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59355c2-1ac6-4b38-9585-f3d299010a8d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.684978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4933e417-4c84-48f0-b8a8-3a3817564250 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.691116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59355c2-1ac6-4b38-9585-f3d299010a8d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.691795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f331e5-f5be-4783-ade3-d1b7f7301711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.692609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f331e5-f5be-4783-ade3-d1b7f7301711 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.693022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f331e5-f5be-4783-ade3-d1b7f7301711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.693355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f331e5-f5be-4783-ade3-d1b7f7301711 admin admin] PATH_INFO: `/v3/projects/a9cf5d13ddd047f788e918d9b1c67f7b/users/14e459bbc0064fac872e4444bff7d3de/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.695452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f9a2e8-6941-4234-ab68-1d0606a782b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.696134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9a2e8-6941-4234-ab68-1d0606a782b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.696258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f331e5-f5be-4783-ade3-d1b7f7301711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9cf5d13ddd047f788e918d9b1c67f7b, user_id=14e459bbc0064fac872e4444bff7d3de, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.696421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9a2e8-6941-4234-ab68-1d0606a782b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.696702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f9a2e8-6941-4234-ab68-1d0606a782b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.697851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9a2e8-6941-4234-ab68-1d0606a782b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.699225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f9a2e8-6941-4234-ab68-1d0606a782b1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.699981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f331e5-f5be-4783-ade3-d1b7f7301711 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.711863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 978/1932] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:49.721575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 955/1933] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:49 2022] PUT /identity/v3/projects/a9cf5d13ddd047f788e918d9b1c67f7b/users/14e459bbc0064fac872e4444bff7d3de/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:49.726162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f331e5-f5be-4783-ade3-d1b7f7301711 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.731616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a96a9d-bbd5-4871-bda8-14929e2c98d6 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.731924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a96a9d-bbd5-4871-bda8-14929e2c98d6 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.732265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a96a9d-bbd5-4871-bda8-14929e2c98d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.794076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-65a96a9d-bbd5-4871-bda8-14929e2c98d6 None None] MFA Rules not processed for user `14e459bbc0064fac872e4444bff7d3de`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:49.795357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-65a96a9d-bbd5-4871-bda8-14929e2c98d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:49.850896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f331e5-f5be-4783-ade3-d1b7f7301711 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.859265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eab78-7efa-46ab-b5a6-35ba01a40ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:49.859978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eab78-7efa-46ab-b5a6-35ba01a40ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.860260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eab78-7efa-46ab-b5a6-35ba01a40ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.860536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eab78-7efa-46ab-b5a6-35ba01a40ba2 admin admin] PATH_INFO: `/v3/projects/295083b93e6b44ebac62aea4710cae22/users/08d8a2c7c615422e81433909b25909eb/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:49.877658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eab78-7efa-46ab-b5a6-35ba01a40ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=295083b93e6b44ebac62aea4710cae22, user_id=08d8a2c7c615422e81433909b25909eb, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:49.880380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eab78-7efa-46ab-b5a6-35ba01a40ba2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:49.883654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 979/1934] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:49.906260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a96a9d-bbd5-4871-bda8-14929e2c98d6 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:49.909878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-65a96a9d-bbd5-4871-bda8-14929e2c98d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:49.971083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a96a9d-bbd5-4871-bda8-14929e2c98d6 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:49.974603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 956/1935] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:49 2022] PUT /identity/v3/projects/295083b93e6b44ebac62aea4710cae22/users/08d8a2c7c615422e81433909b25909eb/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:49.993792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198622da-29c7-4aac-b059-8fbd2f46eeee None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:49.994194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198622da-29c7-4aac-b059-8fbd2f46eeee None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:49.994558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198622da-29c7-4aac-b059-8fbd2f46eeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:50.020867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa9db-77cc-42d1-8370-cf72b2e92917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:50.021477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa9db-77cc-42d1-8370-cf72b2e92917 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:50.021758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa9db-77cc-42d1-8370-cf72b2e92917 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:50.022029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa9db-77cc-42d1-8370-cf72b2e92917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:50.025125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-198622da-29c7-4aac-b059-8fbd2f46eeee None None] MFA Rules not processed for user `08d8a2c7c615422e81433909b25909eb`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:50.026414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-198622da-29c7-4aac-b059-8fbd2f46eeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:50.081484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fa9db-77cc-42d1-8370-cf72b2e92917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:50.083139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fa9db-77cc-42d1-8370-cf72b2e92917 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:50.094689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 980/1936] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:49 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:50.096348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 957/1937] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:52:50.106593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa9db-77cc-42d1-8370-cf72b2e92917 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:50.108947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e59fa9db-77cc-42d1-8370-cf72b2e92917 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:50.180320 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa9db-77cc-42d1-8370-cf72b2e92917 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:50.184384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5f9e9-4dd5-42bc-91dc-529e0f5f014f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:50.185236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f9e9-4dd5-42bc-91dc-529e0f5f014f service glance] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:50.185671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f9e9-4dd5-42bc-91dc-529e0f5f014f service glance] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:50.185953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5f9e9-4dd5-42bc-91dc-529e0f5f014f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:50.194987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5f9e9-4dd5-42bc-91dc-529e0f5f014f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:50.196455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5f9e9-4dd5-42bc-91dc-529e0f5f014f service glance] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:50.207722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 981/1938] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:50.989418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:51.882537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198622da-29c7-4aac-b059-8fbd2f46eeee None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:51.945395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198622da-29c7-4aac-b059-8fbd2f46eeee None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:51.949902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:51.950670 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:51.951614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:51.951904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] PATH_INFO: `/v3/users/4c07cbc1907c43fc889a8753f7c90b28` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:51.953029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c07cbc1907c43fc889a8753f7c90b28)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:51.954968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.237067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c07cbc1907c43fc889a8753f7c90b28'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.244042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c07cbc1907c43fc889a8753f7c90b28'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.244729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c07cbc1907c43fc889a8753f7c90b28'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.245330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c07cbc1907c43fc889a8753f7c90b28'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.369083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c07cbc1907c43fc889a8753f7c90b28'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:52.387337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 958/1939] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:51 2022] DELETE /identity/v3/users/4c07cbc1907c43fc889a8753f7c90b28 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:52.392254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea1f3e-e7db-4b4f-baaa-6081a74e7fa8 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.392748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea1f3e-e7db-4b4f-baaa-6081a74e7fa8 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.392826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ea1f3e-e7db-4b4f-baaa-6081a74e7fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.411922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-a2ea1f3e-e7db-4b4f-baaa-6081a74e7fa8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:52.413119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a2ea1f3e-e7db-4b4f-baaa-6081a74e7fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.472601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 982/1940] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:52.482411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:52.483829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:52.546646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c38e50-f858-495c-8467-4fac93243346 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:52.550600 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01246c-a77a-4ae9-a0e7-fe79d859f8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:52.551335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01246c-a77a-4ae9-a0e7-fe79d859f8ea service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:52.556296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01246c-a77a-4ae9-a0e7-fe79d859f8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:52.556296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01246c-a77a-4ae9-a0e7-fe79d859f8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:52.561421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01246c-a77a-4ae9-a0e7-fe79d859f8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:52.562918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01246c-a77a-4ae9-a0e7-fe79d859f8ea service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:52.573038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 959/1941] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:52:53.382337 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea1f3e-e7db-4b4f-baaa-6081a74e7fa8 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:53.383831 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a2ea1f3e-e7db-4b4f-baaa-6081a74e7fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:53.396009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ea1f3e-e7db-4b4f-baaa-6081a74e7fa8 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:53.401894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:53.402790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:53.403222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:53.404415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] PATH_INFO: `/v3/projects/bee3a4f2a49042b988bcd0418bd1c4ee` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:53.405957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bee3a4f2a49042b988bcd0418bd1c4ee)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:53.408117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:53.448803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:53.556590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bee3a4f2a49042b988bcd0418bd1c4ee', 'request_id': 'req-82e068dc-b0de-46af-8c7f-0124621f9818'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.119636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bee3a4f2a49042b988bcd0418bd1c4ee', 'request_id': 'req-82e068dc-b0de-46af-8c7f-0124621f9818'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.119636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bee3a4f2a49042b988bcd0418bd1c4ee', 'request_id': 'req-82e068dc-b0de-46af-8c7f-0124621f9818'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.119636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] The token cache is being invalidate because project bee3a4f2a49042b988bcd0418bd1c4ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:54.119636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.121378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.121378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 983/1942] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:53 2022] DELETE /identity/v3/projects/bee3a4f2a49042b988bcd0418bd1c4ee => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:54.122253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01246c-a77a-4ae9-a0e7-fe79d859f8ea service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:54.122253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01246c-a77a-4ae9-a0e7-fe79d859f8ea service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:54.122253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:54.122253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:54.123284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:54.123284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] PATH_INFO: `/v3/users/14e459bbc0064fac872e4444bff7d3de` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:54.123284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14e459bbc0064fac872e4444bff7d3de)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:54.123284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:54.409322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14e459bbc0064fac872e4444bff7d3de'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.416648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14e459bbc0064fac872e4444bff7d3de'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.417320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14e459bbc0064fac872e4444bff7d3de'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.417924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14e459bbc0064fac872e4444bff7d3de'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.500397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-aa62df2e-49e9-4094-8e28-be7a2d2e56f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14e459bbc0064fac872e4444bff7d3de'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:54.518386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 960/1943] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:52:54 2022] DELETE /identity/v3/users/14e459bbc0064fac872e4444bff7d3de => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:54.971756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:55.128740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:55.130164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:55.143407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e068dc-b0de-46af-8c7f-0124621f9818 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:55.197776 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:55.198403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:55.198684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:55.198956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] PATH_INFO: `/v3/projects/a9cf5d13ddd047f788e918d9b1c67f7b` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:55.200103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9cf5d13ddd047f788e918d9b1c67f7b)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:55.202074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:55.334506 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9cf5d13ddd047f788e918d9b1c67f7b', 'request_id': 'req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:55.432348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9cf5d13ddd047f788e918d9b1c67f7b', 'request_id': 'req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:55.439203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9cf5d13ddd047f788e918d9b1c67f7b', 'request_id': 'req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:55.450330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] The token cache is being invalidate because project a9cf5d13ddd047f788e918d9b1c67f7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:52:55.450561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:55.451731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a180a4e0-1b8f-4b58-a7cd-f6ffd60c5696 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:52:55.453231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 984/1944] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:52:55 2022] DELETE /identity/v3/projects/a9cf5d13ddd047f788e918d9b1c67f7b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:55.457999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191cdb7-8327-4afe-9a84-9c9ef392d4d6 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:55.458465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191cdb7-8327-4afe-9a84-9c9ef392d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:55.458570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191cdb7-8327-4afe-9a84-9c9ef392d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:55.479206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b191cdb7-8327-4afe-9a84-9c9ef392d4d6 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:55.480501 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b191cdb7-8327-4afe-9a84-9c9ef392d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:55.547234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 961/1945] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:55.548964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b31e4-edbb-4e0a-aaf5-a4ef98bff7b8 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:55.549346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b31e4-edbb-4e0a-aaf5-a4ef98bff7b8 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:55.549628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b31e4-edbb-4e0a-aaf5-a4ef98bff7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:55.572057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-805b31e4-edbb-4e0a-aaf5-a4ef98bff7b8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:55.576680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-805b31e4-edbb-4e0a-aaf5-a4ef98bff7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:55.583128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 985/1946] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:55.587931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191cdb7-8327-4afe-9a84-9c9ef392d4d6 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:55.603238 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191cdb7-8327-4afe-9a84-9c9ef392d4d6 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:55.608628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaddf6-db4e-4e09-96a3-f09cc9372d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:55.609269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaddf6-db4e-4e09-96a3-f09cc9372d4d admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:55.609589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaddf6-db4e-4e09-96a3-f09cc9372d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:55.609925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddaddf6-db4e-4e09-96a3-f09cc9372d4d admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:55.610689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaddf6-db4e-4e09-96a3-f09cc9372d4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:52:55.611111 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaddf6-db4e-4e09-96a3-f09cc9372d4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:55.612945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bddaddf6-db4e-4e09-96a3-f09cc9372d4d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:55.632189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 962/1947] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:52:55.634987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b31e4-edbb-4e0a-aaf5-a4ef98bff7b8 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:55.645574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b31e4-edbb-4e0a-aaf5-a4ef98bff7b8 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:55.652481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe815f5c-bccb-4edb-9a06-1be7171baa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:55.653097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe815f5c-bccb-4edb-9a06-1be7171baa06 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:55.653375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe815f5c-bccb-4edb-9a06-1be7171baa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:55.653643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe815f5c-bccb-4edb-9a06-1be7171baa06 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:55.655606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe815f5c-bccb-4edb-9a06-1be7171baa06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:55.658213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe815f5c-bccb-4edb-9a06-1be7171baa06 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:55.868865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 986/1948] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:55 2022] POST /identity/v3/projects => generated 385 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:55.872621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaddf6-db4e-4e09-96a3-f09cc9372d4d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:55.889401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddaddf6-db4e-4e09-96a3-f09cc9372d4d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:55.969482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef03f2-3a98-48be-a394-4178e945cbac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:55.970103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef03f2-3a98-48be-a394-4178e945cbac admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:55.970385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef03f2-3a98-48be-a394-4178e945cbac admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:55.970663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ef03f2-3a98-48be-a394-4178e945cbac admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:55.971331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef03f2-3a98-48be-a394-4178e945cbac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:55.973268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ef03f2-3a98-48be-a394-4178e945cbac admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:56.085552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 963/1949] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:55 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:56.089950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe815f5c-bccb-4edb-9a06-1be7171baa06 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:56.101949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe815f5c-bccb-4edb-9a06-1be7171baa06 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:56.106575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a572add-67bc-405c-975d-60786e2dcd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:56.107273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a572add-67bc-405c-975d-60786e2dcd5f admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:56.107529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a572add-67bc-405c-975d-60786e2dcd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:56.107819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a572add-67bc-405c-975d-60786e2dcd5f admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:56.108636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a572add-67bc-405c-975d-60786e2dcd5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:56.110538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a572add-67bc-405c-975d-60786e2dcd5f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:56.123029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 987/1950] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:52:56.124279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef03f2-3a98-48be-a394-4178e945cbac admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:56.135503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ef03f2-3a98-48be-a394-4178e945cbac admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:56.140819 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09045d65-caee-46d3-8f0d-74b6dd0bd8f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:56.141615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09045d65-caee-46d3-8f0d-74b6dd0bd8f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:56.141900 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09045d65-caee-46d3-8f0d-74b6dd0bd8f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:56.142228 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09045d65-caee-46d3-8f0d-74b6dd0bd8f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:56.142931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09045d65-caee-46d3-8f0d-74b6dd0bd8f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:56.144655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09045d65-caee-46d3-8f0d-74b6dd0bd8f3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:56.155884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 964/1951] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:56.159921 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a572add-67bc-405c-975d-60786e2dcd5f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:56.170852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a572add-67bc-405c-975d-60786e2dcd5f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:56.174996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fa021-987d-4ace-bbf7-e0ce18e0c866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:56.175725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fa021-987d-4ace-bbf7-e0ce18e0c866 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:56.176078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fa021-987d-4ace-bbf7-e0ce18e0c866 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:56.176457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00fa021-987d-4ace-bbf7-e0ce18e0c866 admin admin] PATH_INFO: `/v3/projects/c70825ba4d3e4ffdaa90d7b6ac10415a/users/0019a0e9a1e24bdb9ff82d22e1b058d6/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:56.193228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fa021-987d-4ace-bbf7-e0ce18e0c866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c70825ba4d3e4ffdaa90d7b6ac10415a, user_id=0019a0e9a1e24bdb9ff82d22e1b058d6, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:56.196074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00fa021-987d-4ace-bbf7-e0ce18e0c866 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:56.344636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 988/1952] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:56 2022] PUT /identity/v3/projects/c70825ba4d3e4ffdaa90d7b6ac10415a/users/0019a0e9a1e24bdb9ff82d22e1b058d6/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:56.350549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d43d-b045-4494-8361-2bae8fa25b02 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:56.350871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d43d-b045-4494-8361-2bae8fa25b02 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:56.351202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7d43d-b045-4494-8361-2bae8fa25b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:56.384467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-04f7d43d-b045-4494-8361-2bae8fa25b02 None None] MFA Rules not processed for user `0019a0e9a1e24bdb9ff82d22e1b058d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:56.385944 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-04f7d43d-b045-4494-8361-2bae8fa25b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:56.456723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 965/1953] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:56.461360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fa021-987d-4ace-bbf7-e0ce18e0c866 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:56.528605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00fa021-987d-4ace-bbf7-e0ce18e0c866 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:56.533896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae03ac-75a5-4bed-9e5d-1a71798278d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:56.534514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae03ac-75a5-4bed-9e5d-1a71798278d2 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:56.534796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae03ac-75a5-4bed-9e5d-1a71798278d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:56.535071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae03ac-75a5-4bed-9e5d-1a71798278d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:56.535750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae03ac-75a5-4bed-9e5d-1a71798278d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:56.537668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae03ac-75a5-4bed-9e5d-1a71798278d2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:56.704093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 989/1954] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:52:56 2022] POST /identity/v3/projects => generated 385 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:56.708244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7d43d-b045-4494-8361-2bae8fa25b02 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:56.720443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7d43d-b045-4494-8361-2bae8fa25b02 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:56.734569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:56.780648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f7a52-a18d-4822-8669-64d00578ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:56.781260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7a52-a18d-4822-8669-64d00578ad95 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:56.781542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7a52-a18d-4822-8669-64d00578ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:56.781811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f7a52-a18d-4822-8669-64d00578ad95 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:56.782439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f7a52-a18d-4822-8669-64d00578ad95 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:56.784370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f7a52-a18d-4822-8669-64d00578ad95 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:56.948068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 966/1955] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:52:56 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:52:56.949967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae03ac-75a5-4bed-9e5d-1a71798278d2 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:56.966155 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae03ac-75a5-4bed-9e5d-1a71798278d2 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:56.971617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01cc03-0418-465a-afc5-7a94f62ce357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:56.972227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01cc03-0418-465a-afc5-7a94f62ce357 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:56.972507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01cc03-0418-465a-afc5-7a94f62ce357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:56.972784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f01cc03-0418-465a-afc5-7a94f62ce357 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:56.973465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01cc03-0418-465a-afc5-7a94f62ce357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:56.975146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f01cc03-0418-465a-afc5-7a94f62ce357 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:56.988037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 990/1956] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:56.996811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f7a52-a18d-4822-8669-64d00578ad95 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:57.001386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f7a52-a18d-4822-8669-64d00578ad95 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:57.006439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790f8d6-5b2f-4af3-bfb5-8517d161b4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:57.007101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790f8d6-5b2f-4af3-bfb5-8517d161b4b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:57.007385 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790f8d6-5b2f-4af3-bfb5-8517d161b4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:57.007736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790f8d6-5b2f-4af3-bfb5-8517d161b4b2 admin admin] PATH_INFO: `/v3/projects/663a254dd0de47b6ae3cd54610860d7f/users/2d52b386a28043128994faf1cd5d7729/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:57.026539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790f8d6-5b2f-4af3-bfb5-8517d161b4b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=663a254dd0de47b6ae3cd54610860d7f, user_id=2d52b386a28043128994faf1cd5d7729, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:57.029836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790f8d6-5b2f-4af3-bfb5-8517d161b4b2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:57.218475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 967/1957] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:56 2022] PUT /identity/v3/projects/663a254dd0de47b6ae3cd54610860d7f/users/2d52b386a28043128994faf1cd5d7729/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:52:57.222473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01cc03-0418-465a-afc5-7a94f62ce357 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:57.232170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f01cc03-0418-465a-afc5-7a94f62ce357 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:57.288332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7be5de0-1a17-4ac6-bb2c-72835b83e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:57.288855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be5de0-1a17-4ac6-bb2c-72835b83e5da admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:57.289136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be5de0-1a17-4ac6-bb2c-72835b83e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:57.289411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7be5de0-1a17-4ac6-bb2c-72835b83e5da admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:57.290060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be5de0-1a17-4ac6-bb2c-72835b83e5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:57.291829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7be5de0-1a17-4ac6-bb2c-72835b83e5da admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:57.302779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 991/1958] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:52:57.312549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790f8d6-5b2f-4af3-bfb5-8517d161b4b2 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:57.322885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790f8d6-5b2f-4af3-bfb5-8517d161b4b2 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:57.328504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5b72e-cf20-4b5e-b707-4a86335a985e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:57.329305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b72e-cf20-4b5e-b707-4a86335a985e admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:57.329797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b72e-cf20-4b5e-b707-4a86335a985e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:57.330133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e5b72e-cf20-4b5e-b707-4a86335a985e admin admin] PATH_INFO: `/v3/projects/663a254dd0de47b6ae3cd54610860d7f/users/2d52b386a28043128994faf1cd5d7729/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:57.332150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5b72e-cf20-4b5e-b707-4a86335a985e admin admin] RBAC: Authorizing `identity:create_grant(project_id=663a254dd0de47b6ae3cd54610860d7f, user_id=2d52b386a28043128994faf1cd5d7729, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:57.334747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e5b72e-cf20-4b5e-b707-4a86335a985e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:57.346195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 968/1959] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:52:57 2022] PUT /identity/v3/projects/663a254dd0de47b6ae3cd54610860d7f/users/2d52b386a28043128994faf1cd5d7729/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:52:57.358130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7e6a9-22b8-4745-864c-dcb153fcbe65 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:57.359046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7e6a9-22b8-4745-864c-dcb153fcbe65 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:57.359046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e7e6a9-22b8-4745-864c-dcb153fcbe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:57.387340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-16e7e6a9-22b8-4745-864c-dcb153fcbe65 None None] MFA Rules not processed for user `2d52b386a28043128994faf1cd5d7729`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:52:57.389341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-16e7e6a9-22b8-4745-864c-dcb153fcbe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:57.456851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 992/1960] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:52:57 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:52:57.468972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5b72e-cf20-4b5e-b707-4a86335a985e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:57.470731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f8e5b72e-cf20-4b5e-b707-4a86335a985e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:57.530357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e5b72e-cf20-4b5e-b707-4a86335a985e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:57.534149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b1e9-a4c9-4cf0-a413-df5c4bbd424b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:57.534758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b1e9-a4c9-4cf0-a413-df5c4bbd424b service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:57.535038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b1e9-a4c9-4cf0-a413-df5c4bbd424b service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:57.535310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276b1e9-a4c9-4cf0-a413-df5c4bbd424b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:57.594006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276b1e9-a4c9-4cf0-a413-df5c4bbd424b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:57.595538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9276b1e9-a4c9-4cf0-a413-df5c4bbd424b service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:57.604391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 969/1961] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:52:57.828918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:59.289482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:52:59.871432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7e6a9-22b8-4745-864c-dcb153fcbe65 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:52:59.881255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e7e6a9-22b8-4745-864c-dcb153fcbe65 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:52:59.884939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d1ad89-619a-4b32-b63c-bab0e85edc70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:52:59.885553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1ad89-619a-4b32-b63c-bab0e85edc70 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:52:59.885834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1ad89-619a-4b32-b63c-bab0e85edc70 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:52:59.886109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d1ad89-619a-4b32-b63c-bab0e85edc70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:52:59.887923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f2d1ad89-619a-4b32-b63c-bab0e85edc70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:52:59.951401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1ad89-619a-4b32-b63c-bab0e85edc70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:52:59.952874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d1ad89-619a-4b32-b63c-bab0e85edc70 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:52:59.962895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 993/1962] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:52:59 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:00.486583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:01.655825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:02.581594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:03.638306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b1e9-a4c9-4cf0-a413-df5c4bbd424b service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:03.639910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9276b1e9-a4c9-4cf0-a413-df5c4bbd424b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:03.661418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:03.706038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276b1e9-a4c9-4cf0-a413-df5c4bbd424b service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:03.710728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:03.711375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:03.711688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:03.711992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] PATH_INFO: `/v3/users/529b916707e54aceb2f324a0d1a7f138` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:03.713215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=529b916707e54aceb2f324a0d1a7f138)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:03.715407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:03.960941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '529b916707e54aceb2f324a0d1a7f138'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:03.970093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '529b916707e54aceb2f324a0d1a7f138'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:03.971197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '529b916707e54aceb2f324a0d1a7f138'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:03.974785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '529b916707e54aceb2f324a0d1a7f138'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:04.163807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '529b916707e54aceb2f324a0d1a7f138'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:04.184432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 970/1963] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:03 2022] DELETE /identity/v3/users/529b916707e54aceb2f324a0d1a7f138 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:04.188930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c86e5-70ad-4661-b661-536f2539d957 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:04.189221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c86e5-70ad-4661-b661-536f2539d957 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:04.189495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c86e5-70ad-4661-b661-536f2539d957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:04.208884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8d2c86e5-70ad-4661-b661-536f2539d957 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:04.210182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8d2c86e5-70ad-4661-b661-536f2539d957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:04.334097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 994/1964] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:04.353596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:04.357463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:04.509418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e205743b-10e5-4681-85a9-be0726835f85 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:04.516546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac70092-635b-44e2-83f2-8b2b101a19fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:04.517612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac70092-635b-44e2-83f2-8b2b101a19fb service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:04.517964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac70092-635b-44e2-83f2-8b2b101a19fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:04.518332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac70092-635b-44e2-83f2-8b2b101a19fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:04.534856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac70092-635b-44e2-83f2-8b2b101a19fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:04.537205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac70092-635b-44e2-83f2-8b2b101a19fb service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:04.543719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:04.580101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 971/1965] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:04.660715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:04.943804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e409-22b2-4700-94f4-0683be18359d None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:04.944533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e409-22b2-4700-94f4-0683be18359d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:04.944533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2562e409-22b2-4700-94f4-0683be18359d None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:04.945719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 995/1966] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:53:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:53:04.953060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d35350-bb22-40d4-a655-7aba0ecc8fdc None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:04.953499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d35350-bb22-40d4-a655-7aba0ecc8fdc None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:04.953633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d35350-bb22-40d4-a655-7aba0ecc8fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:04.981705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-11d35350-bb22-40d4-a655-7aba0ecc8fdc None None] MFA Rules not processed for user `22aa2b6e4b854de4868b75cc9626b8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:04.983193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-11d35350-bb22-40d4-a655-7aba0ecc8fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:05.055173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 972/1967] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:53:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:05.071163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e409-22b2-4700-94f4-0683be18359d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:05.073429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2562e409-22b2-4700-94f4-0683be18359d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:05.094271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2562e409-22b2-4700-94f4-0683be18359d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:05.102700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d523b11-1eb4-4dfc-8f52-3e260c339675 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:05.103408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d523b11-1eb4-4dfc-8f52-3e260c339675 service placement] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:05.103931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d523b11-1eb4-4dfc-8f52-3e260c339675 service placement] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:05.104275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d523b11-1eb4-4dfc-8f52-3e260c339675 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:05.113926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d35350-bb22-40d4-a655-7aba0ecc8fdc None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:05.114089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d523b11-1eb4-4dfc-8f52-3e260c339675 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:05.115540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-11d35350-bb22-40d4-a655-7aba0ecc8fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:05.115653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d523b11-1eb4-4dfc-8f52-3e260c339675 service placement] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:05.127982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 996/1968] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:05.131624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d35350-bb22-40d4-a655-7aba0ecc8fdc None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:05.141998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:05.141998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:05.141998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:05.141998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] PATH_INFO: `/v3/users/b7ec03a4ed404a1aad608e125d4f0df8` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:05.143073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7ec03a4ed404a1aad608e125d4f0df8)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:05.144829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:05.254562 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d523b11-1eb4-4dfc-8f52-3e260c339675 service placement] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:05.256068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6d523b11-1eb4-4dfc-8f52-3e260c339675 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:05.278969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d523b11-1eb4-4dfc-8f52-3e260c339675 service placement] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:05.284894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:05.285496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:05.285789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:05.286042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] PATH_INFO: `/v3/projects/1a61d543b73c4768ba6ba5de593162ca` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:05.287272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a61d543b73c4768ba6ba5de593162ca)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:05.289245 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:05.402474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7ec03a4ed404a1aad608e125d4f0df8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.409767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7ec03a4ed404a1aad608e125d4f0df8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.410461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7ec03a4ed404a1aad608e125d4f0df8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.411056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7ec03a4ed404a1aad608e125d4f0df8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.446454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a61d543b73c4768ba6ba5de593162ca', 'request_id': 'req-47743a54-3e3d-4558-99a5-9d25cd43f36a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.554945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7ec03a4ed404a1aad608e125d4f0df8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.573587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 973/1969] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:05 2022] DELETE /identity/v3/users/b7ec03a4ed404a1aad608e125d4f0df8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:05.686318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a61d543b73c4768ba6ba5de593162ca', 'request_id': 'req-47743a54-3e3d-4558-99a5-9d25cd43f36a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.698545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a61d543b73c4768ba6ba5de593162ca', 'request_id': 'req-47743a54-3e3d-4558-99a5-9d25cd43f36a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.711311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] The token cache is being invalidate because project 1a61d543b73c4768ba6ba5de593162ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:05.711656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.712289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:05.717877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 997/1970] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:05 2022] DELETE /identity/v3/projects/1a61d543b73c4768ba6ba5de593162ca => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:05.721223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:05.721893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:05.723733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:05.809987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136bf9ca-0755-4d3f-a17b-4883e14559fe admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:05.815009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:05.815854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:05.816198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:05.816536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] PATH_INFO: `/v3/users/0de803a1aac743f08d1cf91475ac36fa` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:05.817795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0de803a1aac743f08d1cf91475ac36fa)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:05.819832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:05.843890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:05.845388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:05.905829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47743a54-3e3d-4558-99a5-9d25cd43f36a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:05.952639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:05.953220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:05.953441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:05.953709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:05.955399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:06.022915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:06.024409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:06.034855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 998/1971] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:05 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:06.036495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:06.038963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:06.053428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12886-cce0-4f98-907f-a654dc1c5553 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:06.056976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:06.057685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.058045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.058393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] PATH_INFO: `/v3/projects/f4d6ce9c2a5c4f93b73d64a499fe5a66` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.059626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4d6ce9c2a5c4f93b73d64a499fe5a66)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:06.062079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:06.118546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0de803a1aac743f08d1cf91475ac36fa'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.127020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0de803a1aac743f08d1cf91475ac36fa'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.127832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0de803a1aac743f08d1cf91475ac36fa'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.128500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0de803a1aac743f08d1cf91475ac36fa'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.198381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4d6ce9c2a5c4f93b73d64a499fe5a66', 'request_id': 'req-1c0ae760-122e-43f2-8f2d-ddde367df5f1'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.217961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d9dee566-bcb9-43d9-bc81-292fa6c69481 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0de803a1aac743f08d1cf91475ac36fa'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.235374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 974/1972] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:05 2022] DELETE /identity/v3/users/0de803a1aac743f08d1cf91475ac36fa => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:06.366908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4d6ce9c2a5c4f93b73d64a499fe5a66', 'request_id': 'req-1c0ae760-122e-43f2-8f2d-ddde367df5f1'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.374246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4d6ce9c2a5c4f93b73d64a499fe5a66', 'request_id': 'req-1c0ae760-122e-43f2-8f2d-ddde367df5f1'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.384617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] The token cache is being invalidate because project f4d6ce9c2a5c4f93b73d64a499fe5a66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:06.384912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.385560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1c0ae760-122e-43f2-8f2d-ddde367df5f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:06.387074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 999/1973] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:06 2022] DELETE /identity/v3/projects/f4d6ce9c2a5c4f93b73d64a499fe5a66 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:06.392701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487809b-474d-44ee-a7b0-5c01ba4fa7ef None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.393059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487809b-474d-44ee-a7b0-5c01ba4fa7ef None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.397889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f487809b-474d-44ee-a7b0-5c01ba4fa7ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.412598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f487809b-474d-44ee-a7b0-5c01ba4fa7ef None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:06.413809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f487809b-474d-44ee-a7b0-5c01ba4fa7ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:06.471320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 975/1974] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:06.478918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6282d6-81d7-410e-9233-85bb091f7185 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.480612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6282d6-81d7-410e-9233-85bb091f7185 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.480612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6282d6-81d7-410e-9233-85bb091f7185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.498947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-0e6282d6-81d7-410e-9233-85bb091f7185 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:06.500180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0e6282d6-81d7-410e-9233-85bb091f7185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:06.509820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1000/1975] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:06.514829 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487809b-474d-44ee-a7b0-5c01ba4fa7ef None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:06.526314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f487809b-474d-44ee-a7b0-5c01ba4fa7ef None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:06.531464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b99bd-47d0-4e6b-af7c-3bc30aa836cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:06.532197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b99bd-47d0-4e6b-af7c-3bc30aa836cc admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.532384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b99bd-47d0-4e6b-af7c-3bc30aa836cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.532659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b99bd-47d0-4e6b-af7c-3bc30aa836cc admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.533314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b99bd-47d0-4e6b-af7c-3bc30aa836cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:06.533617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b99bd-47d0-4e6b-af7c-3bc30aa836cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:06.535208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b99bd-47d0-4e6b-af7c-3bc30aa836cc admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:06.576355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 976/1976] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:06.580626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6282d6-81d7-410e-9233-85bb091f7185 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:06.594759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6282d6-81d7-410e-9233-85bb091f7185 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:06.599040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35b3ee-ac30-4e57-87f3-5853e44f4842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:06.600323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35b3ee-ac30-4e57-87f3-5853e44f4842 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.600797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35b3ee-ac30-4e57-87f3-5853e44f4842 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.601271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35b3ee-ac30-4e57-87f3-5853e44f4842 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.602091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35b3ee-ac30-4e57-87f3-5853e44f4842 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:06.604496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b35b3ee-ac30-4e57-87f3-5853e44f4842 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:06.745112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1001/1977] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:06 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:06.746407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b99bd-47d0-4e6b-af7c-3bc30aa836cc admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:06.757048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b99bd-47d0-4e6b-af7c-3bc30aa836cc admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:06.811366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865650e-9435-41ec-8796-e2cba55afd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:06.811998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865650e-9435-41ec-8796-e2cba55afd34 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.812277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865650e-9435-41ec-8796-e2cba55afd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.812550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865650e-9435-41ec-8796-e2cba55afd34 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.813174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865650e-9435-41ec-8796-e2cba55afd34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:06.815062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865650e-9435-41ec-8796-e2cba55afd34 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:06.854170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35b3ee-ac30-4e57-87f3-5853e44f4842 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:06.855912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4b35b3ee-ac30-4e57-87f3-5853e44f4842 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:06.869722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35b3ee-ac30-4e57-87f3-5853e44f4842 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:06.875267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:06.876046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:06.876423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:06.876799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] PATH_INFO: `/v3/projects/4001dd25828f4374950f91fe0a1d45f0` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:06.878038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4001dd25828f4374950f91fe0a1d45f0)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:06.880093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.053772 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 977/1978] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:06 2022] POST /identity/v3/users => generated 293 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:07.059634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865650e-9435-41ec-8796-e2cba55afd34 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.072569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865650e-9435-41ec-8796-e2cba55afd34 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.073121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4001dd25828f4374950f91fe0a1d45f0', 'request_id': 'req-d2b3ed57-7b29-4119-a9b9-3d744843e314'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:07.133810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c55413-2c9f-4e44-af07-adb2bdc4dab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.134429 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c55413-2c9f-4e44-af07-adb2bdc4dab2 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.134712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c55413-2c9f-4e44-af07-adb2bdc4dab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.134987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c55413-2c9f-4e44-af07-adb2bdc4dab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.135672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c55413-2c9f-4e44-af07-adb2bdc4dab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.137301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c55413-2c9f-4e44-af07-adb2bdc4dab2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.146808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 978/1979] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:07.150579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c55413-2c9f-4e44-af07-adb2bdc4dab2 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.155444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4001dd25828f4374950f91fe0a1d45f0', 'request_id': 'req-d2b3ed57-7b29-4119-a9b9-3d744843e314'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:07.164168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c55413-2c9f-4e44-af07-adb2bdc4dab2 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.164293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4001dd25828f4374950f91fe0a1d45f0', 'request_id': 'req-d2b3ed57-7b29-4119-a9b9-3d744843e314'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:07.168474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f3e3f-e2f1-4f24-8b42-0edb1f962bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.168978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f3e3f-e2f1-4f24-8b42-0edb1f962bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.169396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f3e3f-e2f1-4f24-8b42-0edb1f962bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.169785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f3e3f-e2f1-4f24-8b42-0edb1f962bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.171098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f3e3f-e2f1-4f24-8b42-0edb1f962bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.173512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f3e3f-e2f1-4f24-8b42-0edb1f962bc8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.177149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] The token cache is being invalidate because project 4001dd25828f4374950f91fe0a1d45f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:07.177452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:07.178288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2b3ed57-7b29-4119-a9b9-3d744843e314 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:07.183557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1002/1980] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:06 2022] DELETE /identity/v3/projects/4001dd25828f4374950f91fe0a1d45f0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:07.185351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289aa0-5128-4b60-a3a2-e1430ba655ce None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.185772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289aa0-5128-4b60-a3a2-e1430ba655ce None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.186083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289aa0-5128-4b60-a3a2-e1430ba655ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.191638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 979/1981] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:07.193233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f3e3f-e2f1-4f24-8b42-0edb1f962bc8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.195465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e89f3e3f-e2f1-4f24-8b42-0edb1f962bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.209032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f3e3f-e2f1-4f24-8b42-0edb1f962bc8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.211463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f7289aa0-5128-4b60-a3a2-e1430ba655ce None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:07.212772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f7289aa0-5128-4b60-a3a2-e1430ba655ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.214971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21e8e3-9df6-4d59-918a-2d30c373b92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.215923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21e8e3-9df6-4d59-918a-2d30c373b92d admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.216209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21e8e3-9df6-4d59-918a-2d30c373b92d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.216482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21e8e3-9df6-4d59-918a-2d30c373b92d admin admin] PATH_INFO: `/v3/projects/547861b78888459cb718fc9fdbdd7505/users/1a3d054ba88540449fb5c5e579b29827/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.230237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1003/1982] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:07.232218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdcf04-bcd5-4490-b641-90cc5d5a2f8b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.233222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdcf04-bcd5-4490-b641-90cc5d5a2f8b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.233698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdcf04-bcd5-4490-b641-90cc5d5a2f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.234386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21e8e3-9df6-4d59-918a-2d30c373b92d admin admin] RBAC: Authorizing `identity:create_grant(project_id=547861b78888459cb718fc9fdbdd7505, user_id=1a3d054ba88540449fb5c5e579b29827, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.237169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d21e8e3-9df6-4d59-918a-2d30c373b92d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.253380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c9fdcf04-bcd5-4490-b641-90cc5d5a2f8b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:07.258748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c9fdcf04-bcd5-4490-b641-90cc5d5a2f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.262316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1004/1983] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:07.266859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdcf04-bcd5-4490-b641-90cc5d5a2f8b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.275543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdcf04-bcd5-4490-b641-90cc5d5a2f8b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.280879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d65e5-5eb5-4274-bc72-336364e283e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.281461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d65e5-5eb5-4274-bc72-336364e283e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.281736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d65e5-5eb5-4274-bc72-336364e283e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.282003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d65e5-5eb5-4274-bc72-336364e283e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.282641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d65e5-5eb5-4274-bc72-336364e283e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:07.282963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d65e5-5eb5-4274-bc72-336364e283e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.284579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d65e5-5eb5-4274-bc72-336364e283e8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.295716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1005/1984] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:53:07.299735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d65e5-5eb5-4274-bc72-336364e283e8 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.308758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d65e5-5eb5-4274-bc72-336364e283e8 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.313288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d604a32-416c-4b30-9030-41ee129d88d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.314105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d604a32-416c-4b30-9030-41ee129d88d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.314385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d604a32-416c-4b30-9030-41ee129d88d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.314661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d604a32-416c-4b30-9030-41ee129d88d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.315275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d604a32-416c-4b30-9030-41ee129d88d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.317168 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d604a32-416c-4b30-9030-41ee129d88d8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.322057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 980/1985] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:07 2022] PUT /identity/v3/projects/547861b78888459cb718fc9fdbdd7505/users/1a3d054ba88540449fb5c5e579b29827/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:07.333892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350f23-8c27-426a-ad37-4d735fb88241 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.334176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350f23-8c27-426a-ad37-4d735fb88241 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.334446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98350f23-8c27-426a-ad37-4d735fb88241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.365341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-98350f23-8c27-426a-ad37-4d735fb88241 None None] MFA Rules not processed for user `1a3d054ba88540449fb5c5e579b29827`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:07.366585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-98350f23-8c27-426a-ad37-4d735fb88241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.431119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 981/1986] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:07.443754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350f23-8c27-426a-ad37-4d735fb88241 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.445192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-98350f23-8c27-426a-ad37-4d735fb88241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:07.493966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1006/1987] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:07 2022] POST /identity/v3/projects => generated 355 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:07.498585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d604a32-416c-4b30-9030-41ee129d88d8 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.520885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98350f23-8c27-426a-ad37-4d735fb88241 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.562359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d604a32-416c-4b30-9030-41ee129d88d8 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.568386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c7ad1-c116-446b-b7e6-31758fc485c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.569067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c7ad1-c116-446b-b7e6-31758fc485c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.569348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c7ad1-c116-446b-b7e6-31758fc485c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.569798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c7ad1-c116-446b-b7e6-31758fc485c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.571062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c7ad1-c116-446b-b7e6-31758fc485c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.573036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36c7ad1-c116-446b-b7e6-31758fc485c6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.600511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbccd3-2d1d-4c2e-ae40-af76ff893a53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.601132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbccd3-2d1d-4c2e-ae40-af76ff893a53 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.601412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbccd3-2d1d-4c2e-ae40-af76ff893a53 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.601678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abbccd3-2d1d-4c2e-ae40-af76ff893a53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.657512 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbccd3-2d1d-4c2e-ae40-af76ff893a53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.659446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abbccd3-2d1d-4c2e-ae40-af76ff893a53 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.670627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 982/1988] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:07.719669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1007/1989] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:07 2022] POST /identity/v3/users => generated 278 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:07.723838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbccd3-2d1d-4c2e-ae40-af76ff893a53 service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.736708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abbccd3-2d1d-4c2e-ae40-af76ff893a53 service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.742625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558efee5-319b-405e-ac59-bc16e66d9181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.743262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558efee5-319b-405e-ac59-bc16e66d9181 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.747880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558efee5-319b-405e-ac59-bc16e66d9181 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.747880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558efee5-319b-405e-ac59-bc16e66d9181 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.747880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558efee5-319b-405e-ac59-bc16e66d9181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.747880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558efee5-319b-405e-ac59-bc16e66d9181 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.761748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 983/1990] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:07.766535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c7ad1-c116-446b-b7e6-31758fc485c6 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.779788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36c7ad1-c116-446b-b7e6-31758fc485c6 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.782600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed0d02-8eea-4e7f-aad4-48cea7cc52f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.783211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed0d02-8eea-4e7f-aad4-48cea7cc52f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.783497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed0d02-8eea-4e7f-aad4-48cea7cc52f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.783806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed0d02-8eea-4e7f-aad4-48cea7cc52f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.784619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed0d02-8eea-4e7f-aad4-48cea7cc52f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.786306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed0d02-8eea-4e7f-aad4-48cea7cc52f8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.796722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1008/1991] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:07.801001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558efee5-319b-405e-ac59-bc16e66d9181 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:07.811777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558efee5-319b-405e-ac59-bc16e66d9181 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:07.816571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbcc60-0ac9-47f8-a86b-f3f0127b4d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:07.817426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbcc60-0ac9-47f8-a86b-f3f0127b4d84 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.817560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbcc60-0ac9-47f8-a86b-f3f0127b4d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.817780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbcc60-0ac9-47f8-a86b-f3f0127b4d84 admin admin] PATH_INFO: `/v3/projects/2ea05442a1b54ee7ae55229d3dae3dfb/users/1a81b937922443bdb3f7ae555119422b/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.832823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbcc60-0ac9-47f8-a86b-f3f0127b4d84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea05442a1b54ee7ae55229d3dae3dfb, user_id=1a81b937922443bdb3f7ae555119422b, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:07.835453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dbcc60-0ac9-47f8-a86b-f3f0127b4d84 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:07.955785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 984/1992] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:07 2022] PUT /identity/v3/projects/2ea05442a1b54ee7ae55229d3dae3dfb/users/1a81b937922443bdb3f7ae555119422b/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:07.966983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f6bc-7d1a-4093-8d16-8fddd79620af None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:07.967268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f6bc-7d1a-4093-8d16-8fddd79620af None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:07.967568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7f6bc-7d1a-4093-8d16-8fddd79620af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:07.994557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8ba7f6bc-7d1a-4093-8d16-8fddd79620af None None] MFA Rules not processed for user `1a81b937922443bdb3f7ae555119422b`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:07.995803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8ba7f6bc-7d1a-4093-8d16-8fddd79620af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:08.046908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:08.060004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1009/1993] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:07 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:08.064267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbcc60-0ac9-47f8-a86b-f3f0127b4d84 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:08.131643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbcc60-0ac9-47f8-a86b-f3f0127b4d84 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:08.137315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1fb8c-55d5-4899-8e02-f95d4e150235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:08.137981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1fb8c-55d5-4899-8e02-f95d4e150235 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:08.138222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1fb8c-55d5-4899-8e02-f95d4e150235 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:08.138498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff1fb8c-55d5-4899-8e02-f95d4e150235 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:08.139167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1fb8c-55d5-4899-8e02-f95d4e150235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:08.141125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff1fb8c-55d5-4899-8e02-f95d4e150235 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:08.276069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 985/1994] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:08 2022] POST /identity/v3/projects => generated 357 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:08.281310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7f6bc-7d1a-4093-8d16-8fddd79620af None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:08.291789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7f6bc-7d1a-4093-8d16-8fddd79620af None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:08.347058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b548bbd-5bc5-4cd9-92fe-c13071cc5148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:08.347750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b548bbd-5bc5-4cd9-92fe-c13071cc5148 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:08.348034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b548bbd-5bc5-4cd9-92fe-c13071cc5148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:08.348313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b548bbd-5bc5-4cd9-92fe-c13071cc5148 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:08.348940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b548bbd-5bc5-4cd9-92fe-c13071cc5148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:08.350855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b548bbd-5bc5-4cd9-92fe-c13071cc5148 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:08.516196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1010/1995] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:08 2022] POST /identity/v3/users => generated 285 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:08.520403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1fb8c-55d5-4899-8e02-f95d4e150235 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:08.537569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff1fb8c-55d5-4899-8e02-f95d4e150235 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:08.542363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a6be2-9e35-4dc1-8f7a-fd2a150c6a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:08.543140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a6be2-9e35-4dc1-8f7a-fd2a150c6a54 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:08.543469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a6be2-9e35-4dc1-8f7a-fd2a150c6a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:08.543850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377a6be2-9e35-4dc1-8f7a-fd2a150c6a54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:08.544570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a6be2-9e35-4dc1-8f7a-fd2a150c6a54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:08.546826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377a6be2-9e35-4dc1-8f7a-fd2a150c6a54 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:08.563783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 986/1996] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:08.564901 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b548bbd-5bc5-4cd9-92fe-c13071cc5148 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:08.581688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b548bbd-5bc5-4cd9-92fe-c13071cc5148 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:08.594430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfede9c9-6be8-4f67-acdd-64785caa0ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:08.597927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede9c9-6be8-4f67-acdd-64785caa0ae8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:08.598355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede9c9-6be8-4f67-acdd-64785caa0ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:08.598789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfede9c9-6be8-4f67-acdd-64785caa0ae8 admin admin] PATH_INFO: `/v3/projects/b762a24358c148469afdab49e32b3ab1/users/cb2ea3cb1f974b9c8d88738c3ab89a23/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:08.627348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfede9c9-6be8-4f67-acdd-64785caa0ae8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b762a24358c148469afdab49e32b3ab1, user_id=cb2ea3cb1f974b9c8d88738c3ab89a23, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:08.630273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfede9c9-6be8-4f67-acdd-64785caa0ae8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:08.780388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1011/1997] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:08 2022] PUT /identity/v3/projects/b762a24358c148469afdab49e32b3ab1/users/cb2ea3cb1f974b9c8d88738c3ab89a23/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:08.784217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a6be2-9e35-4dc1-8f7a-fd2a150c6a54 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:08.796043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377a6be2-9e35-4dc1-8f7a-fd2a150c6a54 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:08.861083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d9894-bc91-4fc1-a2af-a140e517a0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:08.861695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d9894-bc91-4fc1-a2af-a140e517a0d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:08.862006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d9894-bc91-4fc1-a2af-a140e517a0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:08.862234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d9894-bc91-4fc1-a2af-a140e517a0d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:08.862879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d9894-bc91-4fc1-a2af-a140e517a0d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:08.864490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d9894-bc91-4fc1-a2af-a140e517a0d9 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:08.876100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 987/1998] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:08.883882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfede9c9-6be8-4f67-acdd-64785caa0ae8 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:08.894945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfede9c9-6be8-4f67-acdd-64785caa0ae8 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:08.899980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d69b29-2556-4de9-8698-6a2294cda9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:08.900667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d69b29-2556-4de9-8698-6a2294cda9bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:08.900949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d69b29-2556-4de9-8698-6a2294cda9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:08.901222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d69b29-2556-4de9-8698-6a2294cda9bd admin admin] PATH_INFO: `/v3/projects/b762a24358c148469afdab49e32b3ab1/users/cb2ea3cb1f974b9c8d88738c3ab89a23/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:08.903134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d69b29-2556-4de9-8698-6a2294cda9bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b762a24358c148469afdab49e32b3ab1, user_id=cb2ea3cb1f974b9c8d88738c3ab89a23, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:08.906496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d69b29-2556-4de9-8698-6a2294cda9bd admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:08.925913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1012/1999] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:08 2022] PUT /identity/v3/projects/b762a24358c148469afdab49e32b3ab1/users/cb2ea3cb1f974b9c8d88738c3ab89a23/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:08.928132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a68e-8081-43ca-bd20-e93ecd33a911 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:08.928315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a68e-8081-43ca-bd20-e93ecd33a911 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:08.928643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c07a68e-8081-43ca-bd20-e93ecd33a911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:08.959813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8c07a68e-8081-43ca-bd20-e93ecd33a911 None None] MFA Rules not processed for user `cb2ea3cb1f974b9c8d88738c3ab89a23`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:08.961331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8c07a68e-8081-43ca-bd20-e93ecd33a911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:09.034968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 988/2000] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:08 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:09.046203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d69b29-2556-4de9-8698-6a2294cda9bd admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:09.047996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-58d69b29-2556-4de9-8698-6a2294cda9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:09.104183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d69b29-2556-4de9-8698-6a2294cda9bd admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:09.108304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b51855-5d86-4b7c-9b34-0d97fd145c8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:09.109194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b51855-5d86-4b7c-9b34-0d97fd145c8f service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:09.109620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b51855-5d86-4b7c-9b34-0d97fd145c8f service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:09.109952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b51855-5d86-4b7c-9b34-0d97fd145c8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:09.119129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b51855-5d86-4b7c-9b34-0d97fd145c8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:09.120602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b51855-5d86-4b7c-9b34-0d97fd145c8f service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:09.130060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1013/2001] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:09 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:09.418379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07a68e-8081-43ca-bd20-e93ecd33a911 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:09.427721 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c07a68e-8081-43ca-bd20-e93ecd33a911 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:09.431477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d255f-0b03-44f4-b580-b2e0379420ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:09.432155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d255f-0b03-44f4-b580-b2e0379420ed service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:09.432438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d255f-0b03-44f4-b580-b2e0379420ed service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:09.432624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:09.433285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d255f-0b03-44f4-b580-b2e0379420ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:09.489262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d255f-0b03-44f4-b580-b2e0379420ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:09.490678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d255f-0b03-44f4-b580-b2e0379420ed service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:09.500237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 989/2002] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:09 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:11.269400 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:12.178159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:12.989635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b51855-5d86-4b7c-9b34-0d97fd145c8f service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:12.991087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-21b51855-5d86-4b7c-9b34-0d97fd145c8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:13.093874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b51855-5d86-4b7c-9b34-0d97fd145c8f service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:13.102741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:13.103464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:13.103853 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:13.104180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] PATH_INFO: `/v3/users/0019a0e9a1e24bdb9ff82d22e1b058d6` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:13.105693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0019a0e9a1e24bdb9ff82d22e1b058d6)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:13.107487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:13.403079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0019a0e9a1e24bdb9ff82d22e1b058d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:13.409905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0019a0e9a1e24bdb9ff82d22e1b058d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:13.410567 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0019a0e9a1e24bdb9ff82d22e1b058d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:13.411214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0019a0e9a1e24bdb9ff82d22e1b058d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:13.529467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0019a0e9a1e24bdb9ff82d22e1b058d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:13.548384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1014/2003] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:12 2022] DELETE /identity/v3/users/0019a0e9a1e24bdb9ff82d22e1b058d6 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:13.552878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd82d-41b2-4abe-b969-654c1d52989b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:13.553375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd82d-41b2-4abe-b969-654c1d52989b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:13.553470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88afd82d-41b2-4abe-b969-654c1d52989b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:13.573679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-88afd82d-41b2-4abe-b969-654c1d52989b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:13.574927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-88afd82d-41b2-4abe-b969-654c1d52989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:13.640742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 990/2004] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:13.651100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:13.652675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:13.710077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd3fe7-c87a-48bb-855c-a18d50779159 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:13.713709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49d4d-8ac5-4696-b01e-d1465270c16b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:13.714313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49d4d-8ac5-4696-b01e-d1465270c16b service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:13.714597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49d4d-8ac5-4696-b01e-d1465270c16b service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:13.714869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca49d4d-8ac5-4696-b01e-d1465270c16b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:13.724547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca49d4d-8ac5-4696-b01e-d1465270c16b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:13.726006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca49d4d-8ac5-4696-b01e-d1465270c16b service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:13.736134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1015/2005] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:13.866907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:14.199173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afd82d-41b2-4abe-b969-654c1d52989b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:14.200867 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-88afd82d-41b2-4abe-b969-654c1d52989b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:14.216224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88afd82d-41b2-4abe-b969-654c1d52989b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:14.223673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:14.228603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.228603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.228603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] PATH_INFO: `/v3/projects/c70825ba4d3e4ffdaa90d7b6ac10415a` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:14.228603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c70825ba4d3e4ffdaa90d7b6ac10415a)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:14.231011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:14.397844 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c70825ba4d3e4ffdaa90d7b6ac10415a', 'request_id': 'req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.481562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c70825ba4d3e4ffdaa90d7b6ac10415a', 'request_id': 'req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.490301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c70825ba4d3e4ffdaa90d7b6ac10415a', 'request_id': 'req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.501641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] The token cache is being invalidate because project c70825ba4d3e4ffdaa90d7b6ac10415a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:14.501936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.502605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.504136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 991/2006] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:14 2022] DELETE /identity/v3/projects/c70825ba4d3e4ffdaa90d7b6ac10415a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:14.508209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49d4d-8ac5-4696-b01e-d1465270c16b service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:14.518464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca49d4d-8ac5-4696-b01e-d1465270c16b service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:14.573834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:14.574363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.574642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.574914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] PATH_INFO: `/v3/users/2d52b386a28043128994faf1cd5d7729` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:14.576051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d52b386a28043128994faf1cd5d7729)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:14.578147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:14.765491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:14.766316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:14.787941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e651ffd-7da2-4b53-bbe7-a5b7c9ea1d7b admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:14.792741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:14.793572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:14.793859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:14.794137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] PATH_INFO: `/v3/users/1a3d054ba88540449fb5c5e579b29827` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:14.795272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a3d054ba88540449fb5c5e579b29827)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:14.796235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d52b386a28043128994faf1cd5d7729'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.797410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:14.808047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d52b386a28043128994faf1cd5d7729'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.812193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d52b386a28043128994faf1cd5d7729'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.812193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d52b386a28043128994faf1cd5d7729'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.827326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:14.946526 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40128b70-90bc-42b8-b98e-8182a25ea6fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d52b386a28043128994faf1cd5d7729'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:14.973456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1016/2007] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:14 2022] DELETE /identity/v3/users/2d52b386a28043128994faf1cd5d7729 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:15.087262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a3d054ba88540449fb5c5e579b29827'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.095286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a3d054ba88540449fb5c5e579b29827'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.096010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a3d054ba88540449fb5c5e579b29827'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.096615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a3d054ba88540449fb5c5e579b29827'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.226467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a3d054ba88540449fb5c5e579b29827'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.257526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 992/2008] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:14 2022] DELETE /identity/v3/users/1a3d054ba88540449fb5c5e579b29827 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:15.259907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d7dc-27e7-4f07-a385-5930c57df4e3 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:15.260256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d7dc-27e7-4f07-a385-5930c57df4e3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:15.260472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d7dc-27e7-4f07-a385-5930c57df4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:15.283501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-3ba5d7dc-27e7-4f07-a385-5930c57df4e3 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:15.288338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3ba5d7dc-27e7-4f07-a385-5930c57df4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.355953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1017/2009] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:15.366328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:15.367280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.429895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554b6a0-51d8-4ae0-aa77-708d44241ddc admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:15.433732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc7709-00f9-49ca-868f-142269722acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:15.434414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc7709-00f9-49ca-868f-142269722acb service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:15.434761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc7709-00f9-49ca-868f-142269722acb service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:15.435102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc7709-00f9-49ca-868f-142269722acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:15.444901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc7709-00f9-49ca-868f-142269722acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:15.449436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc7709-00f9-49ca-868f-142269722acb service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:15.456958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 993/2010] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:15.480306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5d7dc-27e7-4f07-a385-5930c57df4e3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:15.481837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3ba5d7dc-27e7-4f07-a385-5930c57df4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.496267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5d7dc-27e7-4f07-a385-5930c57df4e3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:15.502972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:15.503723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:15.504071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:15.506681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] PATH_INFO: `/v3/projects/663a254dd0de47b6ae3cd54610860d7f` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:15.506681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663a254dd0de47b6ae3cd54610860d7f)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:15.508608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:15.679244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663a254dd0de47b6ae3cd54610860d7f', 'request_id': 'req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.783807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663a254dd0de47b6ae3cd54610860d7f', 'request_id': 'req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.794312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663a254dd0de47b6ae3cd54610860d7f', 'request_id': 'req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.814618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] The token cache is being invalidate because project 663a254dd0de47b6ae3cd54610860d7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:15.815276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.816307 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b9ec2bf0-0053-47a3-80f5-f4e8857fde69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:15.818308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1018/2011] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:15 2022] DELETE /identity/v3/projects/663a254dd0de47b6ae3cd54610860d7f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:15.826432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ab795-a01c-4c5d-8a5a-368ceaea4ec4 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:15.826881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ab795-a01c-4c5d-8a5a-368ceaea4ec4 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:15.827150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17ab795-a01c-4c5d-8a5a-368ceaea4ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:15.858457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b17ab795-a01c-4c5d-8a5a-368ceaea4ec4 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:15.860340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b17ab795-a01c-4c5d-8a5a-368ceaea4ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.922763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 994/2012] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:15.935333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64a6da-ae20-447a-b33c-83004dba85f5 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:15.935680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64a6da-ae20-447a-b33c-83004dba85f5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:15.935957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64a6da-ae20-447a-b33c-83004dba85f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:15.954447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ab795-a01c-4c5d-8a5a-368ceaea4ec4 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:15.956822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b17ab795-a01c-4c5d-8a5a-368ceaea4ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.963469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ae64a6da-ae20-447a-b33c-83004dba85f5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:15.964741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ae64a6da-ae20-447a-b33c-83004dba85f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:15.975949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1019/2013] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:15.982196 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17ab795-a01c-4c5d-8a5a-368ceaea4ec4 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:15.984227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64a6da-ae20-447a-b33c-83004dba85f5 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.004168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.004820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.008612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.008612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] PATH_INFO: `/v3/projects/547861b78888459cb718fc9fdbdd7505` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.008612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=547861b78888459cb718fc9fdbdd7505)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.008888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae64a6da-ae20-447a-b33c-83004dba85f5 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.009339 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.013204 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20249916-b764-4d48-9f88-998a578d2878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.014151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20249916-b764-4d48-9f88-998a578d2878 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.014548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20249916-b764-4d48-9f88-998a578d2878 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.014900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20249916-b764-4d48-9f88-998a578d2878 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.015854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20249916-b764-4d48-9f88-998a578d2878 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:16.016228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20249916-b764-4d48-9f88-998a578d2878 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.017973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20249916-b764-4d48-9f88-998a578d2878 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.036664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1020/2014] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:16.037838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20249916-b764-4d48-9f88-998a578d2878 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.049028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20249916-b764-4d48-9f88-998a578d2878 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.053588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466c4a-a152-440a-b21b-19ec7274b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.054184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466c4a-a152-440a-b21b-19ec7274b635 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.054467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466c4a-a152-440a-b21b-19ec7274b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.054765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5466c4a-a152-440a-b21b-19ec7274b635 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.055399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5466c4a-a152-440a-b21b-19ec7274b635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.057367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5466c4a-a152-440a-b21b-19ec7274b635 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.103588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547861b78888459cb718fc9fdbdd7505', 'request_id': 'req-8b8f3b46-d969-4006-94fb-c4fbfad3d960'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.159893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1021/2015] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:16 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:16.165090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466c4a-a152-440a-b21b-19ec7274b635 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.181377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547861b78888459cb718fc9fdbdd7505', 'request_id': 'req-8b8f3b46-d969-4006-94fb-c4fbfad3d960'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.193083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547861b78888459cb718fc9fdbdd7505', 'request_id': 'req-8b8f3b46-d969-4006-94fb-c4fbfad3d960'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.201167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] The token cache is being invalidate because project 547861b78888459cb718fc9fdbdd7505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:16.201761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.202580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8b8f3b46-d969-4006-94fb-c4fbfad3d960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:16.204212 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 995/2016] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:15 2022] DELETE /identity/v3/projects/547861b78888459cb718fc9fdbdd7505 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:16.209196 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791d5d3-40d7-43fb-bfbe-1af97b3d6ddd None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.209676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791d5d3-40d7-43fb-bfbe-1af97b3d6ddd None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.209960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791d5d3-40d7-43fb-bfbe-1af97b3d6ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.231268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-3791d5d3-40d7-43fb-bfbe-1af97b3d6ddd None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:16.232583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3791d5d3-40d7-43fb-bfbe-1af97b3d6ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:16.243264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5466c4a-a152-440a-b21b-19ec7274b635 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.250864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445464d-8577-4900-a6b3-39c80ca60242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.251482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445464d-8577-4900-a6b3-39c80ca60242 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.251793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445464d-8577-4900-a6b3-39c80ca60242 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.252085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445464d-8577-4900-a6b3-39c80ca60242 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.252284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 996/2017] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:16.252774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445464d-8577-4900-a6b3-39c80ca60242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.254843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3445464d-8577-4900-a6b3-39c80ca60242 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.261086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7df02-2159-48a1-9e7c-2bcd0054bea1 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.261377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7df02-2159-48a1-9e7c-2bcd0054bea1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.261659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c7df02-2159-48a1-9e7c-2bcd0054bea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.282586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-58c7df02-2159-48a1-9e7c-2bcd0054bea1 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:16.283928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-58c7df02-2159-48a1-9e7c-2bcd0054bea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:16.291839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 997/2018] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:16.295995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7df02-2159-48a1-9e7c-2bcd0054bea1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.304960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c7df02-2159-48a1-9e7c-2bcd0054bea1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.310067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac9fd9-e738-4ffc-8498-7d40e19b8dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.311812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9fd9-e738-4ffc-8498-7d40e19b8dd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.311812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9fd9-e738-4ffc-8498-7d40e19b8dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.311812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ac9fd9-e738-4ffc-8498-7d40e19b8dd8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.312065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac9fd9-e738-4ffc-8498-7d40e19b8dd8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:16.312214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac9fd9-e738-4ffc-8498-7d40e19b8dd8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.313846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ac9fd9-e738-4ffc-8498-7d40e19b8dd8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.330555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 998/2019] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:53:16.330555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:16.331900 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac9fd9-e738-4ffc-8498-7d40e19b8dd8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.342709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ac9fd9-e738-4ffc-8498-7d40e19b8dd8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.347370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb87d6-0aa9-4d63-aa34-bd247b44fa5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.348036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb87d6-0aa9-4d63-aa34-bd247b44fa5f admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.348311 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb87d6-0aa9-4d63-aa34-bd247b44fa5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.348585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cb87d6-0aa9-4d63-aa34-bd247b44fa5f admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.349242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb87d6-0aa9-4d63-aa34-bd247b44fa5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.351121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cb87d6-0aa9-4d63-aa34-bd247b44fa5f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.393366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1022/2020] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:16 2022] POST /identity/v3/users => generated 289 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:16.397149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445464d-8577-4900-a6b3-39c80ca60242 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.398741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3445464d-8577-4900-a6b3-39c80ca60242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:16.411767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445464d-8577-4900-a6b3-39c80ca60242 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.416574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d386-e93f-4a22-97d0-421fa152f622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.417157 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d386-e93f-4a22-97d0-421fa152f622 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.417441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d386-e93f-4a22-97d0-421fa152f622 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.417718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d386-e93f-4a22-97d0-421fa152f622 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.418390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d386-e93f-4a22-97d0-421fa152f622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.420086 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d386-e93f-4a22-97d0-421fa152f622 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.429756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1023/2021] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:16.433770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d386-e93f-4a22-97d0-421fa152f622 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.444079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d386-e93f-4a22-97d0-421fa152f622 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.448751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b770266-3f20-48d8-94e5-5cc75a0b648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.449396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b770266-3f20-48d8-94e5-5cc75a0b648e admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.449678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b770266-3f20-48d8-94e5-5cc75a0b648e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.449951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b770266-3f20-48d8-94e5-5cc75a0b648e admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.450615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b770266-3f20-48d8-94e5-5cc75a0b648e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.452777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b770266-3f20-48d8-94e5-5cc75a0b648e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.466364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1024/2022] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:16.468033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b770266-3f20-48d8-94e5-5cc75a0b648e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.470612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 999/2023] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:16 2022] POST /identity/v3/projects => generated 371 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:16.473808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb87d6-0aa9-4d63-aa34-bd247b44fa5f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.477832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b770266-3f20-48d8-94e5-5cc75a0b648e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.535850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cb87d6-0aa9-4d63-aa34-bd247b44fa5f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.537600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61580cc5-d211-4ec1-9a97-0685dbe0495c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.538260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61580cc5-d211-4ec1-9a97-0685dbe0495c admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.538585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61580cc5-d211-4ec1-9a97-0685dbe0495c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.538856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61580cc5-d211-4ec1-9a97-0685dbe0495c admin admin] PATH_INFO: `/v3/projects/43eb09c4d12f418d8cc42699327fa4c6/users/cd8839e41f2e460680a6d72b31229f15/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.541191 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9ed92-187b-499a-b80b-06e24605c24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.541800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9ed92-187b-499a-b80b-06e24605c24c admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.542075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9ed92-187b-499a-b80b-06e24605c24c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.542564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e9ed92-187b-499a-b80b-06e24605c24c admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.543145 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9ed92-187b-499a-b80b-06e24605c24c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.545194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e9ed92-187b-499a-b80b-06e24605c24c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.564433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61580cc5-d211-4ec1-9a97-0685dbe0495c admin admin] RBAC: Authorizing `identity:create_grant(project_id=43eb09c4d12f418d8cc42699327fa4c6, user_id=cd8839e41f2e460680a6d72b31229f15, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.568262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61580cc5-d211-4ec1-9a97-0685dbe0495c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.656932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1000/2024] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:16 2022] POST /identity/v3/users => generated 286 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:16.661339 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9ed92-187b-499a-b80b-06e24605c24c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.671550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e9ed92-187b-499a-b80b-06e24605c24c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.676661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd3ab9-790c-4e86-95a3-e4efbd4e4cdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.677270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3ab9-790c-4e86-95a3-e4efbd4e4cdb admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.677550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3ab9-790c-4e86-95a3-e4efbd4e4cdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.677824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd3ab9-790c-4e86-95a3-e4efbd4e4cdb admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.678474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd3ab9-790c-4e86-95a3-e4efbd4e4cdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.680866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd3ab9-790c-4e86-95a3-e4efbd4e4cdb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.688323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1025/2025] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:16 2022] PUT /identity/v3/projects/43eb09c4d12f418d8cc42699327fa4c6/users/cd8839e41f2e460680a6d72b31229f15/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:16.693650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1001/2026] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:16.701658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61580cc5-d211-4ec1-9a97-0685dbe0495c admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.705717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a8ddc-9e7f-4d91-b5aa-7117caacd321 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.706010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a8ddc-9e7f-4d91-b5aa-7117caacd321 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.706293 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a8ddc-9e7f-4d91-b5aa-7117caacd321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.743287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-707a8ddc-9e7f-4d91-b5aa-7117caacd321 None None] MFA Rules not processed for user `cd8839e41f2e460680a6d72b31229f15`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:16.747187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-707a8ddc-9e7f-4d91-b5aa-7117caacd321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:16.784375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61580cc5-d211-4ec1-9a97-0685dbe0495c admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.789608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e43d-20a6-4c0f-b844-2036595363f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.790438 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e43d-20a6-4c0f-b844-2036595363f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.790721 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e43d-20a6-4c0f-b844-2036595363f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.790999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4e43d-20a6-4c0f-b844-2036595363f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.791700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4e43d-20a6-4c0f-b844-2036595363f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.793319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e4e43d-20a6-4c0f-b844-2036595363f6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.804864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1026/2027] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:16.809013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e43d-20a6-4c0f-b844-2036595363f6 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.820063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e4e43d-20a6-4c0f-b844-2036595363f6 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.825288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449762e-b4aa-4c96-a902-be19ae69b667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.825991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449762e-b4aa-4c96-a902-be19ae69b667 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.826978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449762e-b4aa-4c96-a902-be19ae69b667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.827336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449762e-b4aa-4c96-a902-be19ae69b667 admin admin] PATH_INFO: `/v3/projects/dec3b79521b943a1a88072d2ac929e3f/users/a04f6ff2cbc643e58cd3bce6d169a318/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.828155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1002/2028] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:16.841664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a8ddc-9e7f-4d91-b5aa-7117caacd321 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:16.843960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-707a8ddc-9e7f-4d91-b5aa-7117caacd321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:16.844431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449762e-b4aa-4c96-a902-be19ae69b667 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dec3b79521b943a1a88072d2ac929e3f, user_id=a04f6ff2cbc643e58cd3bce6d169a318, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.847227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449762e-b4aa-4c96-a902-be19ae69b667 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.900283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707a8ddc-9e7f-4d91-b5aa-7117caacd321 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:16.907634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d13e4b-5947-4d71-9aac-3554f2b0e347 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:16.907634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d13e4b-5947-4d71-9aac-3554f2b0e347 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.907634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d13e4b-5947-4d71-9aac-3554f2b0e347 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.907634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d13e4b-5947-4d71-9aac-3554f2b0e347 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:16.913482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d13e4b-5947-4d71-9aac-3554f2b0e347 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:16.914891 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d13e4b-5947-4d71-9aac-3554f2b0e347 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:16.923562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1003/2029] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:16.981219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1027/2030] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:16 2022] PUT /identity/v3/projects/dec3b79521b943a1a88072d2ac929e3f/users/a04f6ff2cbc643e58cd3bce6d169a318/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:16.988509 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f43e-e37a-428a-a564-32c5a7f6024f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:16.988933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f43e-e37a-428a-a564-32c5a7f6024f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:16.989295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5f43e-e37a-428a-a564-32c5a7f6024f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.022880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-93d5f43e-e37a-428a-a564-32c5a7f6024f None None] MFA Rules not processed for user `a04f6ff2cbc643e58cd3bce6d169a318`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:17.024117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-93d5f43e-e37a-428a-a564-32c5a7f6024f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:17.089193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1004/2031] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:17.100418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449762e-b4aa-4c96-a902-be19ae69b667 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:17.102113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7449762e-b4aa-4c96-a902-be19ae69b667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:17.173097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449762e-b4aa-4c96-a902-be19ae69b667 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:17.178612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036438d4-7681-4a7e-96e2-917f811f761f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:17.179212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036438d4-7681-4a7e-96e2-917f811f761f service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:17.179536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036438d4-7681-4a7e-96e2-917f811f761f service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:17.179822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036438d4-7681-4a7e-96e2-917f811f761f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:17.188397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036438d4-7681-4a7e-96e2-917f811f761f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:17.190071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036438d4-7681-4a7e-96e2-917f811f761f service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:17.200395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1028/2032] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:17.590202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:18.898771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:20.478673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:21.168482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5f43e-e37a-428a-a564-32c5a7f6024f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:21.235646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5f43e-e37a-428a-a564-32c5a7f6024f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:21.240482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:21.241131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.241410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.241677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] PATH_INFO: `/v3/users/a04f6ff2cbc643e58cd3bce6d169a318` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.242826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a04f6ff2cbc643e58cd3bce6d169a318)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:21.244806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:21.479070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a04f6ff2cbc643e58cd3bce6d169a318'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:21.489992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a04f6ff2cbc643e58cd3bce6d169a318'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:21.491053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a04f6ff2cbc643e58cd3bce6d169a318'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:21.492068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a04f6ff2cbc643e58cd3bce6d169a318'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:21.652940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a04f6ff2cbc643e58cd3bce6d169a318'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:21.674967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1005/2033] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:21 2022] DELETE /identity/v3/users/a04f6ff2cbc643e58cd3bce6d169a318 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:21.679582 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eb557-6dfe-4111-8369-27264ddfe5c5 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.680021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eb557-6dfe-4111-8369-27264ddfe5c5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.680370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215eb557-6dfe-4111-8369-27264ddfe5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.705727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-215eb557-6dfe-4111-8369-27264ddfe5c5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:21.707073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-215eb557-6dfe-4111-8369-27264ddfe5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:21.771326 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1029/2034] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:21.781908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:21.783328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:21.840411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e44f9b-23a3-4718-a531-fb87e9f4afa5 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:21.844933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b69efe-1ff9-4806-9350-476337d54583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:21.845606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b69efe-1ff9-4806-9350-476337d54583 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:21.845922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b69efe-1ff9-4806-9350-476337d54583 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:21.846192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b69efe-1ff9-4806-9350-476337d54583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:21.855251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b69efe-1ff9-4806-9350-476337d54583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:21.856711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b69efe-1ff9-4806-9350-476337d54583 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:21.866348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1006/2035] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:22.281359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:22.383250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eb557-6dfe-4111-8369-27264ddfe5c5 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:22.383250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-215eb557-6dfe-4111-8369-27264ddfe5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:22.417449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215eb557-6dfe-4111-8369-27264ddfe5c5 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:22.417449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:22.418116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.418404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.418688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] PATH_INFO: `/v3/projects/dec3b79521b943a1a88072d2ac929e3f` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.419872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dec3b79521b943a1a88072d2ac929e3f)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:22.421964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:22.473083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:22.567580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dec3b79521b943a1a88072d2ac929e3f', 'request_id': 'req-565092cc-1dcc-4f0c-898b-8f700a23953d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:22.733041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dec3b79521b943a1a88072d2ac929e3f', 'request_id': 'req-565092cc-1dcc-4f0c-898b-8f700a23953d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:22.739831 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dec3b79521b943a1a88072d2ac929e3f', 'request_id': 'req-565092cc-1dcc-4f0c-898b-8f700a23953d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:22.750531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] The token cache is being invalidate because project dec3b79521b943a1a88072d2ac929e3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:22.750821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:22.751448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:22.752953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1030/2036] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:22 2022] DELETE /identity/v3/projects/dec3b79521b943a1a88072d2ac929e3f => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:22.757834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d15de-90c8-495f-871b-137c70819765 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.758124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d15de-90c8-495f-871b-137c70819765 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.758404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d15de-90c8-495f-871b-137c70819765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.778764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-eb0d15de-90c8-495f-871b-137c70819765 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:22.780010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-eb0d15de-90c8-495f-871b-137c70819765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:22.815804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:22.817316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:22.847160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1007/2037] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:22.864954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8eaa-ac65-48c6-969f-5b45e23aa9dd None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.864954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8eaa-ac65-48c6-969f-5b45e23aa9dd None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.864954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809b8eaa-ac65-48c6-969f-5b45e23aa9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.879745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-809b8eaa-ac65-48c6-969f-5b45e23aa9dd None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:22.880954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-809b8eaa-ac65-48c6-969f-5b45e23aa9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:22.889128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1008/2038] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:22.893014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565092cc-1dcc-4f0c-898b-8f700a23953d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:22.893924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8eaa-ac65-48c6-969f-5b45e23aa9dd None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:22.896619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:22.897250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.897527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.897800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] PATH_INFO: `/v3/users/08d8a2c7c615422e81433909b25909eb` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.898970 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] RBAC: Authorizing `identity:delete_user(user_id=08d8a2c7c615422e81433909b25909eb)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:22.900996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:22.902987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809b8eaa-ac65-48c6-969f-5b45e23aa9dd None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:22.907729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee8739-37fd-4434-a9a0-5acdcbfdd4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:22.908316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee8739-37fd-4434-a9a0-5acdcbfdd4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.908599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee8739-37fd-4434-a9a0-5acdcbfdd4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.908875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee8739-37fd-4434-a9a0-5acdcbfdd4c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.909528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee8739-37fd-4434-a9a0-5acdcbfdd4c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:22.909822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee8739-37fd-4434-a9a0-5acdcbfdd4c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:22.911387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee8739-37fd-4434-a9a0-5acdcbfdd4c7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:22.922813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1009/2039] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:53:22.926981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee8739-37fd-4434-a9a0-5acdcbfdd4c7 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:22.936391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee8739-37fd-4434-a9a0-5acdcbfdd4c7 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:22.941450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487297-2ee2-44dd-bff4-b664e17d34fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:22.942023 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487297-2ee2-44dd-bff4-b664e17d34fc admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:22.942305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487297-2ee2-44dd-bff4-b664e17d34fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:22.942580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d487297-2ee2-44dd-bff4-b664e17d34fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:22.943195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d487297-2ee2-44dd-bff4-b664e17d34fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:22.945091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d487297-2ee2-44dd-bff4-b664e17d34fc admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.036903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1010/2040] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:22 2022] POST /identity/v3/projects => generated 405 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:23.041028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487297-2ee2-44dd-bff4-b664e17d34fc admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.102688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d487297-2ee2-44dd-bff4-b664e17d34fc admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.107301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688b771-3080-40f5-a89f-1694329d93c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.107938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688b771-3080-40f5-a89f-1694329d93c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.108279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688b771-3080-40f5-a89f-1694329d93c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.108489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688b771-3080-40f5-a89f-1694329d93c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.109148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688b771-3080-40f5-a89f-1694329d93c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.111590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688b771-3080-40f5-a89f-1694329d93c8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.130339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08d8a2c7c615422e81433909b25909eb'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:23.137290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08d8a2c7c615422e81433909b25909eb'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:23.137954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08d8a2c7c615422e81433909b25909eb'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:23.138705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08d8a2c7c615422e81433909b25909eb'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:23.241547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cd1029f2-be2b-48fe-a324-42abebc0080a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08d8a2c7c615422e81433909b25909eb'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:23.249407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1011/2041] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:23 2022] POST /identity/v3/users => generated 303 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:23.260998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688b771-3080-40f5-a89f-1694329d93c8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.262668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1031/2042] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:22 2022] DELETE /identity/v3/users/08d8a2c7c615422e81433909b25909eb => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:23.264561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d688b771-3080-40f5-a89f-1694329d93c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:23.267173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e49f0-11c3-47ec-9f2a-05117e738b7c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.267570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e49f0-11c3-47ec-9f2a-05117e738b7c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.267788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e49f0-11c3-47ec-9f2a-05117e738b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.277803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688b771-3080-40f5-a89f-1694329d93c8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.290804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-465e49f0-11c3-47ec-9f2a-05117e738b7c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:23.291950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-465e49f0-11c3-47ec-9f2a-05117e738b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:23.346985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb64a77-b9af-4b3e-b00c-7772e6ff5647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.348661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb64a77-b9af-4b3e-b00c-7772e6ff5647 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.349124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb64a77-b9af-4b3e-b00c-7772e6ff5647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.350407 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb64a77-b9af-4b3e-b00c-7772e6ff5647 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.350507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb64a77-b9af-4b3e-b00c-7772e6ff5647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.354260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb64a77-b9af-4b3e-b00c-7772e6ff5647 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.357104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1032/2043] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:23.372757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1012/2044] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:23.372963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e49f0-11c3-47ec-9f2a-05117e738b7c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.373554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb64a77-b9af-4b3e-b00c-7772e6ff5647 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.377013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-465e49f0-11c3-47ec-9f2a-05117e738b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:23.390770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb64a77-b9af-4b3e-b00c-7772e6ff5647 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.393559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089f87-a7a4-4940-a01a-2e905b2e0cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.394188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089f87-a7a4-4940-a01a-2e905b2e0cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.394473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089f87-a7a4-4940-a01a-2e905b2e0cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.394806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3089f87-a7a4-4940-a01a-2e905b2e0cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.395470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3089f87-a7a4-4940-a01a-2e905b2e0cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.397345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3089f87-a7a4-4940-a01a-2e905b2e0cf3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.408751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1013/2045] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:23.413711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089f87-a7a4-4940-a01a-2e905b2e0cf3 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.444373 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3089f87-a7a4-4940-a01a-2e905b2e0cf3 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.449539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db10d1-8401-479e-bc74-426d3494a024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.450874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db10d1-8401-479e-bc74-426d3494a024 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.451149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db10d1-8401-479e-bc74-426d3494a024 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.451628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46db10d1-8401-479e-bc74-426d3494a024 admin admin] PATH_INFO: `/v3/projects/8d01a14169404d718facbc0064a6e8fd/users/6b8c114a88644a9e8e124bc872411880/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.454439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e49f0-11c3-47ec-9f2a-05117e738b7c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.459103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2da7c5-46e9-4fd2-8ed5-79fbf45beba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.459830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da7c5-46e9-4fd2-8ed5-79fbf45beba9 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.460142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da7c5-46e9-4fd2-8ed5-79fbf45beba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.461851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2da7c5-46e9-4fd2-8ed5-79fbf45beba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.470881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db10d1-8401-479e-bc74-426d3494a024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d01a14169404d718facbc0064a6e8fd, user_id=6b8c114a88644a9e8e124bc872411880, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.471878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da7c5-46e9-4fd2-8ed5-79fbf45beba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.473315 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2da7c5-46e9-4fd2-8ed5-79fbf45beba9 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.474718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46db10d1-8401-479e-bc74-426d3494a024 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:23.482975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1033/2046] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:23.653934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1014/2047] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:23 2022] PUT /identity/v3/projects/8d01a14169404d718facbc0064a6e8fd/users/6b8c114a88644a9e8e124bc872411880/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:23.666575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade7cf7-0bcf-4d3a-a7db-59c0a6f78412 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.666974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade7cf7-0bcf-4d3a-a7db-59c0a6f78412 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.667301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade7cf7-0bcf-4d3a-a7db-59c0a6f78412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.697778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-3ade7cf7-0bcf-4d3a-a7db-59c0a6f78412 None None] MFA Rules not processed for user `6b8c114a88644a9e8e124bc872411880`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:23.699877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3ade7cf7-0bcf-4d3a-a7db-59c0a6f78412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:23.774422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1034/2048] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:23 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:23.778622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db10d1-8401-479e-bc74-426d3494a024 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:23.846019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46db10d1-8401-479e-bc74-426d3494a024 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:23.850842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf845a5-d97e-452b-acce-dff5287e2f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:23.851776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf845a5-d97e-452b-acce-dff5287e2f6f admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:23.852098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf845a5-d97e-452b-acce-dff5287e2f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:23.852369 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf845a5-d97e-452b-acce-dff5287e2f6f admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:23.853017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf845a5-d97e-452b-acce-dff5287e2f6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:23.854923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf845a5-d97e-452b-acce-dff5287e2f6f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.044780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade7cf7-0bcf-4d3a-a7db-59c0a6f78412 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.047070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3ade7cf7-0bcf-4d3a-a7db-59c0a6f78412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.061644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade7cf7-0bcf-4d3a-a7db-59c0a6f78412 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.066225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.066850 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.067129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.067401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] PATH_INFO: `/v3/projects/295083b93e6b44ebac62aea4710cae22` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.068586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=295083b93e6b44ebac62aea4710cae22)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.070490 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.084033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1015/2049] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:23 2022] POST /identity/v3/projects => generated 403 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:24.088033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf845a5-d97e-452b-acce-dff5287e2f6f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.148628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf845a5-d97e-452b-acce-dff5287e2f6f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.153196 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb141023-a332-4d16-9ea2-6756982d24e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.153792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb141023-a332-4d16-9ea2-6756982d24e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.154068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb141023-a332-4d16-9ea2-6756982d24e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.154340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb141023-a332-4d16-9ea2-6756982d24e9 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.154988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb141023-a332-4d16-9ea2-6756982d24e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.156930 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb141023-a332-4d16-9ea2-6756982d24e9 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.252564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '295083b93e6b44ebac62aea4710cae22', 'request_id': 'req-2a66a5cd-0cc9-45a8-a63f-78215daecf08'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.274611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1016/2050] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:24 2022] POST /identity/v3/users => generated 308 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:24.278482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb141023-a332-4d16-9ea2-6756982d24e9 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.288247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb141023-a332-4d16-9ea2-6756982d24e9 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.356884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b221e6-a01f-4000-a50a-189b1925df79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.359287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b221e6-a01f-4000-a50a-189b1925df79 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.359287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b221e6-a01f-4000-a50a-189b1925df79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.359287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b221e6-a01f-4000-a50a-189b1925df79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.359287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b221e6-a01f-4000-a50a-189b1925df79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.362111 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b221e6-a01f-4000-a50a-189b1925df79 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.377264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1017/2051] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:24.378190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b221e6-a01f-4000-a50a-189b1925df79 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.388285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b221e6-a01f-4000-a50a-189b1925df79 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.394033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374e0b2-b114-4281-8325-01e25343e3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.394825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e0b2-b114-4281-8325-01e25343e3fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.395002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e0b2-b114-4281-8325-01e25343e3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.395238 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374e0b2-b114-4281-8325-01e25343e3fb admin admin] PATH_INFO: `/v3/projects/ee478c430f654cbe8491dac372064b0b/users/6a76001c48e24e12bbb7c810effbf337/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.411833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374e0b2-b114-4281-8325-01e25343e3fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee478c430f654cbe8491dac372064b0b, user_id=6a76001c48e24e12bbb7c810effbf337, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.422294 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374e0b2-b114-4281-8325-01e25343e3fb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.433311 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '295083b93e6b44ebac62aea4710cae22', 'request_id': 'req-2a66a5cd-0cc9-45a8-a63f-78215daecf08'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.442548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '295083b93e6b44ebac62aea4710cae22', 'request_id': 'req-2a66a5cd-0cc9-45a8-a63f-78215daecf08'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.454768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] The token cache is being invalidate because project 295083b93e6b44ebac62aea4710cae22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:24.455067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.455781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2a66a5cd-0cc9-45a8-a63f-78215daecf08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:24.457352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1035/2052] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:24 2022] DELETE /identity/v3/projects/295083b93e6b44ebac62aea4710cae22 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:24.462263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c433-1982-4981-bc6d-4d1ac7f7bb53 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.462584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c433-1982-4981-bc6d-4d1ac7f7bb53 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.463006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8c433-1982-4981-bc6d-4d1ac7f7bb53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.484145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-54a8c433-1982-4981-bc6d-4d1ac7f7bb53 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:24.486134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-54a8c433-1982-4981-bc6d-4d1ac7f7bb53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.494886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1036/2053] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:24.503596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f0427-fb4c-40f7-bc1f-d388f00907c7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.503887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f0427-fb4c-40f7-bc1f-d388f00907c7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.504166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f0427-fb4c-40f7-bc1f-d388f00907c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.525238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d41f0427-fb4c-40f7-bc1f-d388f00907c7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:24.526424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d41f0427-fb4c-40f7-bc1f-d388f00907c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.534570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1037/2054] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:24.538751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f0427-fb4c-40f7-bc1f-d388f00907c7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.548285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f0427-fb4c-40f7-bc1f-d388f00907c7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.553012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9a765-7a50-464a-a0cc-8d773e7f217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.553591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9a765-7a50-464a-a0cc-8d773e7f217b admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.553914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9a765-7a50-464a-a0cc-8d773e7f217b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.554189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9a765-7a50-464a-a0cc-8d773e7f217b admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.554916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9a765-7a50-464a-a0cc-8d773e7f217b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:24.555251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9a765-7a50-464a-a0cc-8d773e7f217b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.557188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f9a765-7a50-464a-a0cc-8d773e7f217b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.564231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1018/2055] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:24 2022] PUT /identity/v3/projects/ee478c430f654cbe8491dac372064b0b/users/6a76001c48e24e12bbb7c810effbf337/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:24.569206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374e0b2-b114-4281-8325-01e25343e3fb admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.577048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1038/2056] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:53:24.578537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1374e0b2-b114-4281-8325-01e25343e3fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.579797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9a765-7a50-464a-a0cc-8d773e7f217b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.597364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f9a765-7a50-464a-a0cc-8d773e7f217b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.661550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374e0b2-b114-4281-8325-01e25343e3fb admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.666614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c6bd-4acb-47ad-ab05-f77238a1aeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.667305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c6bd-4acb-47ad-ab05-f77238a1aeac admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.667707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c6bd-4acb-47ad-ab05-f77238a1aeac admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.668059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c6bd-4acb-47ad-ab05-f77238a1aeac admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.668903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c6bd-4acb-47ad-ab05-f77238a1aeac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.670851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c6bd-4acb-47ad-ab05-f77238a1aeac admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.673094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80d514-1e6c-439a-af15-e6fbcd7eba4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.676137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80d514-1e6c-439a-af15-e6fbcd7eba4d admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.676626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80d514-1e6c-439a-af15-e6fbcd7eba4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.676958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80d514-1e6c-439a-af15-e6fbcd7eba4d admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.677676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80d514-1e6c-439a-af15-e6fbcd7eba4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.679845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80d514-1e6c-439a-af15-e6fbcd7eba4d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.683326 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1019/2057] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:24 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:24.691850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c6bd-4acb-47ad-ab05-f77238a1aeac admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.705728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c6bd-4acb-47ad-ab05-f77238a1aeac admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.711848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1d499d-4ede-4a61-b110-bef537796587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.712591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d499d-4ede-4a61-b110-bef537796587 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.715321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d499d-4ede-4a61-b110-bef537796587 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.715321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1d499d-4ede-4a61-b110-bef537796587 admin admin] PATH_INFO: `/v3/projects/ee478c430f654cbe8491dac372064b0b/users/6a76001c48e24e12bbb7c810effbf337/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.715542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d499d-4ede-4a61-b110-bef537796587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee478c430f654cbe8491dac372064b0b, user_id=6a76001c48e24e12bbb7c810effbf337, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.720195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1d499d-4ede-4a61-b110-bef537796587 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.739602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1020/2058] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:24 2022] PUT /identity/v3/projects/ee478c430f654cbe8491dac372064b0b/users/6a76001c48e24e12bbb7c810effbf337/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:24.743309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d236e-9609-4c16-b6e1-4383fa595ac4 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.743713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d236e-9609-4c16-b6e1-4383fa595ac4 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.744058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0d236e-9609-4c16-b6e1-4383fa595ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.772727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-fc0d236e-9609-4c16-b6e1-4383fa595ac4 None None] MFA Rules not processed for user `6a76001c48e24e12bbb7c810effbf337`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:24.773954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fc0d236e-9609-4c16-b6e1-4383fa595ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.842757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1021/2059] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:24 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:24.855453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d236e-9609-4c16-b6e1-4383fa595ac4 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.856999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fc0d236e-9609-4c16-b6e1-4383fa595ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:24.862237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1039/2060] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:24 2022] POST /identity/v3/projects => generated 383 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:24.863476 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80d514-1e6c-439a-af15-e6fbcd7eba4d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:24.920847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0d236e-9609-4c16-b6e1-4383fa595ac4 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.947789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80d514-1e6c-439a-af15-e6fbcd7eba4d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:24.959222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581b4f-8a5b-422c-865b-037bc2f22c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.959879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581b4f-8a5b-422c-865b-037bc2f22c47 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.960299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581b4f-8a5b-422c-865b-037bc2f22c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.961309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581b4f-8a5b-422c-865b-037bc2f22c47 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:24.962089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4581b4f-8a5b-422c-865b-037bc2f22c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:24.966331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4581b4f-8a5b-422c-865b-037bc2f22c47 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:24.987438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021d8d7-0703-4114-885e-a6e8b7b3a134 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:24.987977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021d8d7-0703-4114-885e-a6e8b7b3a134 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:24.988260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021d8d7-0703-4114-885e-a6e8b7b3a134 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:24.988562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021d8d7-0703-4114-885e-a6e8b7b3a134 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.010607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:25.054378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021d8d7-0703-4114-885e-a6e8b7b3a134 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.055756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021d8d7-0703-4114-885e-a6e8b7b3a134 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.065923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1022/2061] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:24 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:25.100357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1040/2062] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:24 2022] POST /identity/v3/users => generated 292 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:25.106665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021d8d7-0703-4114-885e-a6e8b7b3a134 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.119529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021d8d7-0703-4114-885e-a6e8b7b3a134 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.124449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a48172-9c2d-4709-b8cd-aec2e9142860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.125062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a48172-9c2d-4709-b8cd-aec2e9142860 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.125400 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a48172-9c2d-4709-b8cd-aec2e9142860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.125678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a48172-9c2d-4709-b8cd-aec2e9142860 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.126349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a48172-9c2d-4709-b8cd-aec2e9142860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.128101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a48172-9c2d-4709-b8cd-aec2e9142860 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.138963 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1023/2063] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:25.147143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581b4f-8a5b-422c-865b-037bc2f22c47 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.160461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581b4f-8a5b-422c-865b-037bc2f22c47 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.166821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b18193-fbef-488b-9153-db94938bbfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.167423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b18193-fbef-488b-9153-db94938bbfae admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.167735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b18193-fbef-488b-9153-db94938bbfae admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.168012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b18193-fbef-488b-9153-db94938bbfae admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.168665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b18193-fbef-488b-9153-db94938bbfae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.170334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b18193-fbef-488b-9153-db94938bbfae admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.186392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1041/2064] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:25.193414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a48172-9c2d-4709-b8cd-aec2e9142860 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.205273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a48172-9c2d-4709-b8cd-aec2e9142860 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.210251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709b2b11-6942-452a-aaeb-023cc5ad01d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.211055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2b11-6942-452a-aaeb-023cc5ad01d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.211335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2b11-6942-452a-aaeb-023cc5ad01d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.211636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709b2b11-6942-452a-aaeb-023cc5ad01d5 admin admin] PATH_INFO: `/v3/projects/103c8390284f4076a54932ff458cff38/users/46e426b17c7543fb8cdaf0adff89b667/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.228801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2b11-6942-452a-aaeb-023cc5ad01d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=103c8390284f4076a54932ff458cff38, user_id=46e426b17c7543fb8cdaf0adff89b667, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.231611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709b2b11-6942-452a-aaeb-023cc5ad01d5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.239408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b18193-fbef-488b-9153-db94938bbfae admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.249592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b18193-fbef-488b-9153-db94938bbfae admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.254248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.254851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.255130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.255401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] PATH_INFO: `/v3/users/6b8c114a88644a9e8e124bc872411880` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.256536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b8c114a88644a9e8e124bc872411880)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.258488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.341969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1024/2065] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:25 2022] PUT /identity/v3/projects/103c8390284f4076a54932ff458cff38/users/46e426b17c7543fb8cdaf0adff89b667/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:25.354854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4d2da-8dac-4800-a99b-1b1411e81cea None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.355142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4d2da-8dac-4800-a99b-1b1411e81cea None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.355418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4d2da-8dac-4800-a99b-1b1411e81cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.373885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-6cb4d2da-8dac-4800-a99b-1b1411e81cea None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:25.375094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6cb4d2da-8dac-4800-a99b-1b1411e81cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.433295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1025/2066] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:25.443615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4d2da-8dac-4800-a99b-1b1411e81cea None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.445044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6cb4d2da-8dac-4800-a99b-1b1411e81cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.510408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4d2da-8dac-4800-a99b-1b1411e81cea None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.520714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53386e34-c00f-4e10-a991-abcb75a07dc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.521610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386e34-c00f-4e10-a991-abcb75a07dc7 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.522077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386e34-c00f-4e10-a991-abcb75a07dc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.522419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53386e34-c00f-4e10-a991-abcb75a07dc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.524757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b8c114a88644a9e8e124bc872411880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.532568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386e34-c00f-4e10-a991-abcb75a07dc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.533596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b8c114a88644a9e8e124bc872411880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.533971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53386e34-c00f-4e10-a991-abcb75a07dc7 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.534410 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b8c114a88644a9e8e124bc872411880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.535034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b8c114a88644a9e8e124bc872411880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.544569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1026/2067] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:25.618574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b8c114a88644a9e8e124bc872411880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:25.637913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1042/2068] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:25 2022] DELETE /identity/v3/users/6b8c114a88644a9e8e124bc872411880 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:25.642957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f278f4-30e6-4aea-b07a-fb52bb529839 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.643243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f278f4-30e6-4aea-b07a-fb52bb529839 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.643530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f278f4-30e6-4aea-b07a-fb52bb529839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.664426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-93f278f4-30e6-4aea-b07a-fb52bb529839 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:25.665640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-93f278f4-30e6-4aea-b07a-fb52bb529839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.730119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1027/2069] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:25.739962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:25.741401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:25.825959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eae90a0-c00e-4c2c-821b-21c07a553f8a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:25.825959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d08bb-9b78-4bd1-8ac1-f6f596a7d424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:25.825959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d08bb-9b78-4bd1-8ac1-f6f596a7d424 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:25.825959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d08bb-9b78-4bd1-8ac1-f6f596a7d424 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:25.826422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1d08bb-9b78-4bd1-8ac1-f6f596a7d424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:25.837463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d08bb-9b78-4bd1-8ac1-f6f596a7d424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:25.839274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1d08bb-9b78-4bd1-8ac1-f6f596a7d424 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:25.854363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1043/2070] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:26.301870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:26.851988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f278f4-30e6-4aea-b07a-fb52bb529839 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:26.853486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-93f278f4-30e6-4aea-b07a-fb52bb529839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:26.865714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f278f4-30e6-4aea-b07a-fb52bb529839 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:26.870947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:26.876217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:26.876217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:26.876217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] PATH_INFO: `/v3/projects/8d01a14169404d718facbc0064a6e8fd` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:26.876217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d01a14169404d718facbc0064a6e8fd)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:26.876217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:27.007269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d01a14169404d718facbc0064a6e8fd', 'request_id': 'req-7d4884c1-258d-4958-aca8-fc74bd5c73c5'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.150449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d01a14169404d718facbc0064a6e8fd', 'request_id': 'req-7d4884c1-258d-4958-aca8-fc74bd5c73c5'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.157257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d01a14169404d718facbc0064a6e8fd', 'request_id': 'req-7d4884c1-258d-4958-aca8-fc74bd5c73c5'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.167585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] The token cache is being invalidate because project 8d01a14169404d718facbc0064a6e8fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:27.167875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.168503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7d4884c1-258d-4958-aca8-fc74bd5c73c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.169996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1028/2071] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:26 2022] DELETE /identity/v3/projects/8d01a14169404d718facbc0064a6e8fd => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:27.174020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d08bb-9b78-4bd1-8ac1-f6f596a7d424 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:27.183494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1d08bb-9b78-4bd1-8ac1-f6f596a7d424 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:27.239114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:27.239780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.240058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.240328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] PATH_INFO: `/v3/users/6a76001c48e24e12bbb7c810effbf337` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.241441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a76001c48e24e12bbb7c810effbf337)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:27.243380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:27.454499 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a76001c48e24e12bbb7c810effbf337'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.464932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a76001c48e24e12bbb7c810effbf337'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.464932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a76001c48e24e12bbb7c810effbf337'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.465731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a76001c48e24e12bbb7c810effbf337'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.611781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a76001c48e24e12bbb7c810effbf337'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:27.649484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1044/2072] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:27 2022] DELETE /identity/v3/users/6a76001c48e24e12bbb7c810effbf337 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:27.749511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca1feb-b048-42ea-9192-0a3849b92c02 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:27.750126 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca1feb-b048-42ea-9192-0a3849b92c02 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:27.750648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca1feb-b048-42ea-9192-0a3849b92c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:27.813595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-edca1feb-b048-42ea-9192-0a3849b92c02 None None] MFA Rules not processed for user `46e426b17c7543fb8cdaf0adff89b667`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:27.824456 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-edca1feb-b048-42ea-9192-0a3849b92c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:27.914766 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1029/2073] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:27.928391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:27.933208 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:28.006874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de34fb-a9db-425f-a5ce-de1caf98d045 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:28.014918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080e5d2-7f98-4eb0-88b2-95d9fcd23b64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:28.015825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e5d2-7f98-4eb0-88b2-95d9fcd23b64 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.016118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e5d2-7f98-4eb0-88b2-95d9fcd23b64 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.016432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080e5d2-7f98-4eb0-88b2-95d9fcd23b64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.029579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080e5d2-7f98-4eb0-88b2-95d9fcd23b64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:28.031844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080e5d2-7f98-4eb0-88b2-95d9fcd23b64 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:28.046724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1045/2074] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:28.131986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:28.519021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca1feb-b048-42ea-9192-0a3849b92c02 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:28.521619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-edca1feb-b048-42ea-9192-0a3849b92c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:28.589683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca1feb-b048-42ea-9192-0a3849b92c02 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:28.595155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:28.595820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:28.596105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:28.596382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] PATH_INFO: `/v3/projects/ee478c430f654cbe8491dac372064b0b` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:28.597542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee478c430f654cbe8491dac372064b0b)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:28.599489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:28.805257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee478c430f654cbe8491dac372064b0b', 'request_id': 'req-7859562b-3297-4bc9-b8bd-8443c1f113af'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.018838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee478c430f654cbe8491dac372064b0b', 'request_id': 'req-7859562b-3297-4bc9-b8bd-8443c1f113af'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.025694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee478c430f654cbe8491dac372064b0b', 'request_id': 'req-7859562b-3297-4bc9-b8bd-8443c1f113af'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.047712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] The token cache is being invalidate because project ee478c430f654cbe8491dac372064b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:29.047712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.047712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7859562b-3297-4bc9-b8bd-8443c1f113af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.047712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1030/2075] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:28 2022] DELETE /identity/v3/projects/ee478c430f654cbe8491dac372064b0b => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:29.052132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba113c-a5ee-4f60-9eeb-43d104a1a59e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.052596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba113c-a5ee-4f60-9eeb-43d104a1a59e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.052784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba113c-a5ee-4f60-9eeb-43d104a1a59e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.071880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c2ba113c-a5ee-4f60-9eeb-43d104a1a59e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:29.073025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c2ba113c-a5ee-4f60-9eeb-43d104a1a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:29.132089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1046/2076] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:29.139727 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3cf9-3196-4de0-aee8-a68ca72d4d41 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.140110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3cf9-3196-4de0-aee8-a68ca72d4d41 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.145129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748d3cf9-3196-4de0-aee8-a68ca72d4d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.148873 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba113c-a5ee-4f60-9eeb-43d104a1a59e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.150943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c2ba113c-a5ee-4f60-9eeb-43d104a1a59e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:29.166766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba113c-a5ee-4f60-9eeb-43d104a1a59e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.171656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-748d3cf9-3196-4de0-aee8-a68ca72d4d41 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:29.172354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.173073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.173234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-748d3cf9-3196-4de0-aee8-a68ca72d4d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:29.173389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.174213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] PATH_INFO: `/v3/users/b9835d2c0d204f6a94a8a0545647c9bf` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.175734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9835d2c0d204f6a94a8a0545647c9bf)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.179489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.181871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1031/2077] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:29.186492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d3cf9-3196-4de0-aee8-a68ca72d4d41 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.196823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748d3cf9-3196-4de0-aee8-a68ca72d4d41 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.205322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb522482-9f3e-4edc-8a1d-ace0fba61662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.210208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb522482-9f3e-4edc-8a1d-ace0fba61662 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.210208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb522482-9f3e-4edc-8a1d-ace0fba61662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.210208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb522482-9f3e-4edc-8a1d-ace0fba61662 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.210208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb522482-9f3e-4edc-8a1d-ace0fba61662 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:29.210208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb522482-9f3e-4edc-8a1d-ace0fba61662 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.210208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb522482-9f3e-4edc-8a1d-ace0fba61662 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.223747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1032/2078] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:53:29.226942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb522482-9f3e-4edc-8a1d-ace0fba61662 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.239321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb522482-9f3e-4edc-8a1d-ace0fba61662 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.244578 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb09d-d8e9-4384-9d4f-02365fc822d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.245545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb09d-d8e9-4384-9d4f-02365fc822d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.245964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb09d-d8e9-4384-9d4f-02365fc822d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.246239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160eb09d-d8e9-4384-9d4f-02365fc822d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.246885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eb09d-d8e9-4384-9d4f-02365fc822d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.248802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160eb09d-d8e9-4384-9d4f-02365fc822d8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.347071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:29.354387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1033/2079] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:29 2022] POST /identity/v3/projects => generated 389 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:29.358441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb09d-d8e9-4384-9d4f-02365fc822d8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.419189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160eb09d-d8e9-4384-9d4f-02365fc822d8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.424087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bb9e2-3ac4-470d-937b-1bd7a0059a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.425014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bb9e2-3ac4-470d-937b-1bd7a0059a07 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.425308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bb9e2-3ac4-470d-937b-1bd7a0059a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.425587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714bb9e2-3ac4-470d-937b-1bd7a0059a07 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.426235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bb9e2-3ac4-470d-937b-1bd7a0059a07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.428265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714bb9e2-3ac4-470d-937b-1bd7a0059a07 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.438085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9835d2c0d204f6a94a8a0545647c9bf'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.445698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9835d2c0d204f6a94a8a0545647c9bf'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.446371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9835d2c0d204f6a94a8a0545647c9bf'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.446984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9835d2c0d204f6a94a8a0545647c9bf'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.561767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9835d2c0d204f6a94a8a0545647c9bf'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:29.572134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1034/2080] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:29 2022] POST /identity/v3/users => generated 295 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:29.579381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bb9e2-3ac4-470d-937b-1bd7a0059a07 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.579381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-714bb9e2-3ac4-470d-937b-1bd7a0059a07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:29.594934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714bb9e2-3ac4-470d-937b-1bd7a0059a07 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.596751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da080-2cd2-4b71-83d7-ea430c4a950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.597245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da080-2cd2-4b71-83d7-ea430c4a950f admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.597524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da080-2cd2-4b71-83d7-ea430c4a950f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.598117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83da080-2cd2-4b71-83d7-ea430c4a950f admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.598436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83da080-2cd2-4b71-83d7-ea430c4a950f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.600309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83da080-2cd2-4b71-83d7-ea430c4a950f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.602784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1047/2081] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:29 2022] DELETE /identity/v3/users/b9835d2c0d204f6a94a8a0545647c9bf => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:29.611813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1035/2082] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:29.615837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.691071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0f47-a149-4d9c-8d2f-cbcc6e3b9fb2 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.696084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd1d81-503a-4ebc-abf1-ce717e4e688b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.696691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd1d81-503a-4ebc-abf1-ce717e4e688b admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.696969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd1d81-503a-4ebc-abf1-ce717e4e688b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.697241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd1d81-503a-4ebc-abf1-ce717e4e688b admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.697890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd1d81-503a-4ebc-abf1-ce717e4e688b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.699543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd1d81-503a-4ebc-abf1-ce717e4e688b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.711555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1048/2083] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:29 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:29.714737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da080-2cd2-4b71-83d7-ea430c4a950f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.725124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83da080-2cd2-4b71-83d7-ea430c4a950f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.730386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960747d-d3d4-4afb-9a0f-f466629b87d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.731072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960747d-d3d4-4afb-9a0f-f466629b87d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.731623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960747d-d3d4-4afb-9a0f-f466629b87d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.731745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960747d-d3d4-4afb-9a0f-f466629b87d6 admin admin] PATH_INFO: `/v3/projects/3051ec8e2fe643fb8455e4e1263ab306/users/038d67b9cb3e4eae91a7d573f4c48134/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.747709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960747d-d3d4-4afb-9a0f-f466629b87d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3051ec8e2fe643fb8455e4e1263ab306, user_id=038d67b9cb3e4eae91a7d573f4c48134, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.750389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960747d-d3d4-4afb-9a0f-f466629b87d6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.835964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1036/2084] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:29 2022] PUT /identity/v3/projects/3051ec8e2fe643fb8455e4e1263ab306/users/038d67b9cb3e4eae91a7d573f4c48134/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:29.847473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37602-a7d1-4657-baee-18b2fa4da763 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.847890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37602-a7d1-4657-baee-18b2fa4da763 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.848238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e37602-a7d1-4657-baee-18b2fa4da763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.867605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960747d-d3d4-4afb-9a0f-f466629b87d6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.870763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8960747d-d3d4-4afb-9a0f-f466629b87d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:29.888753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-61e37602-a7d1-4657-baee-18b2fa4da763 None None] MFA Rules not processed for user `038d67b9cb3e4eae91a7d573f4c48134`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:29.893032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-61e37602-a7d1-4657-baee-18b2fa4da763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:29.941883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960747d-d3d4-4afb-9a0f-f466629b87d6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.946693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.947320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.947630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.947909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] PATH_INFO: `/v3/projects/065a6b5a75454e6e8628cd7a34f75c6b` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.949178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=065a6b5a75454e6e8628cd7a34f75c6b)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.951154 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:29.955639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1049/2085] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:29.960368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37602-a7d1-4657-baee-18b2fa4da763 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:29.971062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e37602-a7d1-4657-baee-18b2fa4da763 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:29.976034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d99593-5092-4383-a2db-b39fd0d5ed5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:29.976632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d99593-5092-4383-a2db-b39fd0d5ed5d admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:29.977228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d99593-5092-4383-a2db-b39fd0d5ed5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:29.977367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d99593-5092-4383-a2db-b39fd0d5ed5d admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:29.978013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d99593-5092-4383-a2db-b39fd0d5ed5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:29.979940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d99593-5092-4383-a2db-b39fd0d5ed5d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.108276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1050/2086] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:29 2022] POST /identity/v3/projects => generated 389 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:30.112637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d99593-5092-4383-a2db-b39fd0d5ed5d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.122596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065a6b5a75454e6e8628cd7a34f75c6b', 'request_id': 'req-d2ab31a4-80dd-4842-9215-e2283744aef3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.175614 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d99593-5092-4383-a2db-b39fd0d5ed5d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:30.180617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059bbe6-5402-4556-8d65-89fd01e173fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:30.181338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059bbe6-5402-4556-8d65-89fd01e173fe admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.181616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059bbe6-5402-4556-8d65-89fd01e173fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.182020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059bbe6-5402-4556-8d65-89fd01e173fe admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.182656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059bbe6-5402-4556-8d65-89fd01e173fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:30.184618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059bbe6-5402-4556-8d65-89fd01e173fe admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.208573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065a6b5a75454e6e8628cd7a34f75c6b', 'request_id': 'req-d2ab31a4-80dd-4842-9215-e2283744aef3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.229450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065a6b5a75454e6e8628cd7a34f75c6b', 'request_id': 'req-d2ab31a4-80dd-4842-9215-e2283744aef3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.253440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] The token cache is being invalidate because project 065a6b5a75454e6e8628cd7a34f75c6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:30.254116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.254403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d2ab31a4-80dd-4842-9215-e2283744aef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.259057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1037/2087] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:29 2022] DELETE /identity/v3/projects/065a6b5a75454e6e8628cd7a34f75c6b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:30.259057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf87be-873a-4d6f-8a27-73fbfa9add64 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.259057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf87be-873a-4d6f-8a27-73fbfa9add64 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.259057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf87be-873a-4d6f-8a27-73fbfa9add64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.272502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1051/2088] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:30 2022] POST /identity/v3/users => generated 301 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:30.276034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059bbe6-5402-4556-8d65-89fd01e173fe admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.280429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b059bbe6-5402-4556-8d65-89fd01e173fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.303757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059bbe6-5402-4556-8d65-89fd01e173fe admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:30.303863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-20cf87be-873a-4d6f-8a27-73fbfa9add64 None None] MFA Rules not processed for user `46e426b17c7543fb8cdaf0adff89b667`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:30.303863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-20cf87be-873a-4d6f-8a27-73fbfa9add64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.308115 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:30.312331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.312331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.312331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] PATH_INFO: `/v3/users/64b2c8cc38be45aeb2bcf26b90934847` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.312331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b2c8cc38be45aeb2bcf26b90934847)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:30.312690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.359177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:30.378404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1038/2089] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:30.378404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf87be-873a-4d6f-8a27-73fbfa9add64 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.378404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-20cf87be-873a-4d6f-8a27-73fbfa9add64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.394049 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf87be-873a-4d6f-8a27-73fbfa9add64 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:30.399222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91d9aa-b9aa-4108-a1c3-cfb2683064f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:30.400199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d9aa-b9aa-4108-a1c3-cfb2683064f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.408822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d9aa-b9aa-4108-a1c3-cfb2683064f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.408822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd91d9aa-b9aa-4108-a1c3-cfb2683064f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.408822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91d9aa-b9aa-4108-a1c3-cfb2683064f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:30.408822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd91d9aa-b9aa-4108-a1c3-cfb2683064f6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.419291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1039/2090] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:30.420807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91d9aa-b9aa-4108-a1c3-cfb2683064f6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.432273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd91d9aa-b9aa-4108-a1c3-cfb2683064f6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:30.438534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6163e-02a1-422b-92cf-4e43132cdff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:30.438725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6163e-02a1-422b-92cf-4e43132cdff1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.439013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6163e-02a1-422b-92cf-4e43132cdff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.439202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6163e-02a1-422b-92cf-4e43132cdff1 admin admin] PATH_INFO: `/v3/projects/c3947e0c3d8f4627baacf4d814fdad83/users/f8c3f2d16de04c17809265681dc686d4/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.457521 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6163e-02a1-422b-92cf-4e43132cdff1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3947e0c3d8f4627baacf4d814fdad83, user_id=f8c3f2d16de04c17809265681dc686d4, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:30.460558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6163e-02a1-422b-92cf-4e43132cdff1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.562472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1040/2091] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:30 2022] PUT /identity/v3/projects/c3947e0c3d8f4627baacf4d814fdad83/users/f8c3f2d16de04c17809265681dc686d4/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:30.563280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6163e-02a1-422b-92cf-4e43132cdff1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.637115 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6163e-02a1-422b-92cf-4e43132cdff1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:30.644255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e3885-15cd-4282-a815-e235b59dec19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:30.644967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e3885-15cd-4282-a815-e235b59dec19 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.645257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e3885-15cd-4282-a815-e235b59dec19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.645542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e3885-15cd-4282-a815-e235b59dec19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.646193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e3885-15cd-4282-a815-e235b59dec19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:30.647885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e3885-15cd-4282-a815-e235b59dec19 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.648085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b2c8cc38be45aeb2bcf26b90934847'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.655919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b2c8cc38be45aeb2bcf26b90934847'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.656643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b2c8cc38be45aeb2bcf26b90934847'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.657255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b2c8cc38be45aeb2bcf26b90934847'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.660309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1041/2092] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:30.668551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e3885-15cd-4282-a815-e235b59dec19 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.670251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-236e3885-15cd-4282-a815-e235b59dec19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.687099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e3885-15cd-4282-a815-e235b59dec19 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:30.692046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943af12-5f20-4689-ba4b-7595870105a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:30.692714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943af12-5f20-4689-ba4b-7595870105a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.693000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943af12-5f20-4689-ba4b-7595870105a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.693303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6943af12-5f20-4689-ba4b-7595870105a8 admin admin] PATH_INFO: `/v3/projects/c3947e0c3d8f4627baacf4d814fdad83/users/f8c3f2d16de04c17809265681dc686d4/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.695230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943af12-5f20-4689-ba4b-7595870105a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3947e0c3d8f4627baacf4d814fdad83, user_id=f8c3f2d16de04c17809265681dc686d4, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:30.697916 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6943af12-5f20-4689-ba4b-7595870105a8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.709989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1042/2093] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:30 2022] PUT /identity/v3/projects/c3947e0c3d8f4627baacf4d814fdad83/users/f8c3f2d16de04c17809265681dc686d4/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:30.710848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943af12-5f20-4689-ba4b-7595870105a8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.712539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6943af12-5f20-4689-ba4b-7595870105a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.779787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6943af12-5f20-4689-ba4b-7595870105a8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:30.785065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:30.785693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.785971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.786244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] PATH_INFO: `/v3/users/1a81b937922443bdb3f7ae555119422b` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.787367 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a81b937922443bdb3f7ae555119422b)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:30.789297 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:30.796594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5514c806-8b48-41f5-b64c-21ed63588d4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b2c8cc38be45aeb2bcf26b90934847'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:30.820519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1052/2094] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:30 2022] DELETE /identity/v3/users/64b2c8cc38be45aeb2bcf26b90934847 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:30.821760 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c664e-6189-440b-8477-dd5744a19206 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:30.822054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c664e-6189-440b-8477-dd5744a19206 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:30.822341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c664e-6189-440b-8477-dd5744a19206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:30.855113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-278c664e-6189-440b-8477-dd5744a19206 None None] MFA Rules not processed for user `f8c3f2d16de04c17809265681dc686d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:30.856097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-278c664e-6189-440b-8477-dd5744a19206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:30.935696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1053/2095] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:30 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:30.947444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c664e-6189-440b-8477-dd5744a19206 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:30.948892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-278c664e-6189-440b-8477-dd5744a19206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.005943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c664e-6189-440b-8477-dd5744a19206 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:31.009546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2175-aa36-49d0-bbec-c37e71af375f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:31.010148 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2175-aa36-49d0-bbec-c37e71af375f service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.010430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2175-aa36-49d0-bbec-c37e71af375f service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.010704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335d2175-aa36-49d0-bbec-c37e71af375f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.020185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d2175-aa36-49d0-bbec-c37e71af375f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:31.027090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335d2175-aa36-49d0-bbec-c37e71af375f service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:31.031247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1054/2096] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:30 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:31.087784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2175-aa36-49d0-bbec-c37e71af375f service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:31.089195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-335d2175-aa36-49d0-bbec-c37e71af375f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.099750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a81b937922443bdb3f7ae555119422b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.148642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a81b937922443bdb3f7ae555119422b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.149511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a81b937922443bdb3f7ae555119422b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.151437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a81b937922443bdb3f7ae555119422b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.215544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335d2175-aa36-49d0-bbec-c37e71af375f service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:31.231779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:31.231779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.231779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.231779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] PATH_INFO: `/v3/projects/7b0ff98c410f4a918513d21f063523b6` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.236838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0ff98c410f4a918513d21f063523b6)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:31.236838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:31.258878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a81b937922443bdb3f7ae555119422b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.259423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:31.280460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1043/2097] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:30 2022] DELETE /identity/v3/users/1a81b937922443bdb3f7ae555119422b => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:31.284483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:31.286170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.359487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7273dd-1a05-4f04-a322-50f100358651 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:31.371212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0ff98c410f4a918513d21f063523b6', 'request_id': 'req-711e0edd-44b2-4138-b7ac-1044d83b5664'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.427820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:31.428577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.429133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.429516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] PATH_INFO: `/v3/users/038d67b9cb3e4eae91a7d573f4c48134` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.430851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] RBAC: Authorizing `identity:delete_user(user_id=038d67b9cb3e4eae91a7d573f4c48134)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:31.433005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:31.476399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0ff98c410f4a918513d21f063523b6', 'request_id': 'req-711e0edd-44b2-4138-b7ac-1044d83b5664'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.483715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0ff98c410f4a918513d21f063523b6', 'request_id': 'req-711e0edd-44b2-4138-b7ac-1044d83b5664'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.495113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] The token cache is being invalidate because project 7b0ff98c410f4a918513d21f063523b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:31.495409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.496079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-711e0edd-44b2-4138-b7ac-1044d83b5664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.500737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1055/2098] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:31 2022] DELETE /identity/v3/projects/7b0ff98c410f4a918513d21f063523b6 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:31.500737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59db1-e5f0-4436-a6ac-e1566ebbf866 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.500737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59db1-e5f0-4436-a6ac-e1566ebbf866 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.500737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb59db1-e5f0-4436-a6ac-e1566ebbf866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.521229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9fb59db1-e5f0-4436-a6ac-e1566ebbf866 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:31.522448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9fb59db1-e5f0-4436-a6ac-e1566ebbf866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.530378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1056/2099] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:31.534846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac72502-35ed-4d43-98a5-66768d3f3dc4 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.535125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac72502-35ed-4d43-98a5-66768d3f3dc4 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.535449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac72502-35ed-4d43-98a5-66768d3f3dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.555817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-aac72502-35ed-4d43-98a5-66768d3f3dc4 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:31.557061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-aac72502-35ed-4d43-98a5-66768d3f3dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.577576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1057/2100] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:31.578488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac72502-35ed-4d43-98a5-66768d3f3dc4 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:31.580023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-aac72502-35ed-4d43-98a5-66768d3f3dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.649744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac72502-35ed-4d43-98a5-66768d3f3dc4 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:31.654234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ee76b-bb87-4311-a19b-673bde7ad9d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:31.660924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee76b-bb87-4311-a19b-673bde7ad9d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.660924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee76b-bb87-4311-a19b-673bde7ad9d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.660924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ee76b-bb87-4311-a19b-673bde7ad9d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.662086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '038d67b9cb3e4eae91a7d573f4c48134'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.666766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ee76b-bb87-4311-a19b-673bde7ad9d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:31.668802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ee76b-bb87-4311-a19b-673bde7ad9d1 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:31.670036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '038d67b9cb3e4eae91a7d573f4c48134'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.670953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '038d67b9cb3e4eae91a7d573f4c48134'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.671602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '038d67b9cb3e4eae91a7d573f4c48134'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.680908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1058/2101] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:31.682517 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f64af-7786-440e-ab8b-f7a54ceca0b7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.682708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f64af-7786-440e-ab8b-f7a54ceca0b7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.682987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f64af-7786-440e-ab8b-f7a54ceca0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.711169 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ff2f64af-7786-440e-ab8b-f7a54ceca0b7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:31.712514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ff2f64af-7786-440e-ab8b-f7a54ceca0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.722835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1059/2102] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:31.725933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f64af-7786-440e-ab8b-f7a54ceca0b7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:31.738349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f64af-7786-440e-ab8b-f7a54ceca0b7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:31.744407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008f335-af01-49b5-b211-e16b8fe011ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:31.745396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008f335-af01-49b5-b211-e16b8fe011ab admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.745716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008f335-af01-49b5-b211-e16b8fe011ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.745982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008f335-af01-49b5-b211-e16b8fe011ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.747000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008f335-af01-49b5-b211-e16b8fe011ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:31.747315 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008f335-af01-49b5-b211-e16b8fe011ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:31.749665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008f335-af01-49b5-b211-e16b8fe011ab admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:31.752866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-beae17d7-5a6c-41fc-be58-4a12183ee520 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '038d67b9cb3e4eae91a7d573f4c48134'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:31.762571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1060/2103] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:53:31.767426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008f335-af01-49b5-b211-e16b8fe011ab admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:31.780674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1044/2104] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:31 2022] DELETE /identity/v3/users/038d67b9cb3e4eae91a7d573f4c48134 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:31.780888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008f335-af01-49b5-b211-e16b8fe011ab admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:31.783030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e730a-102c-4dc5-9dc2-17df3fffc4e2 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.784002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e730a-102c-4dc5-9dc2-17df3fffc4e2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.784379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e730a-102c-4dc5-9dc2-17df3fffc4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.808441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-569e730a-102c-4dc5-9dc2-17df3fffc4e2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:31.809803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-569e730a-102c-4dc5-9dc2-17df3fffc4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.835118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261f25d-354d-4f89-a27a-567431820ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:31.835688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f25d-354d-4f89-a27a-567431820ac6 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.835967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f25d-354d-4f89-a27a-567431820ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.836242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f25d-354d-4f89-a27a-567431820ac6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.836870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261f25d-354d-4f89-a27a-567431820ac6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:31.838750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261f25d-354d-4f89-a27a-567431820ac6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:31.887153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1045/2105] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:31.898032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e730a-102c-4dc5-9dc2-17df3fffc4e2 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:31.899472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-569e730a-102c-4dc5-9dc2-17df3fffc4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:31.957709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e730a-102c-4dc5-9dc2-17df3fffc4e2 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:31.961479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db753555-1f1c-416a-9c25-fe17e3080ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:31.962141 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db753555-1f1c-416a-9c25-fe17e3080ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:31.962397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db753555-1f1c-416a-9c25-fe17e3080ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:31.962670 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db753555-1f1c-416a-9c25-fe17e3080ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:31.972852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db753555-1f1c-416a-9c25-fe17e3080ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:31.974267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db753555-1f1c-416a-9c25-fe17e3080ae6 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:31.983787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1046/2106] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:31.998100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1061/2107] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:31 2022] POST /identity/v3/projects => generated 377 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:31.999226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db753555-1f1c-416a-9c25-fe17e3080ae6 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:32.009193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db753555-1f1c-416a-9c25-fe17e3080ae6 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:32.091143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098088a-d466-41bc-8da7-6c749e252add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:32.091760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098088a-d466-41bc-8da7-6c749e252add admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.092299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098088a-d466-41bc-8da7-6c749e252add admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.092579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1098088a-d466-41bc-8da7-6c749e252add admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.093435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098088a-d466-41bc-8da7-6c749e252add admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:32.103140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1098088a-d466-41bc-8da7-6c749e252add admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:32.233773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:32.269830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261f25d-354d-4f89-a27a-567431820ac6 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:32.271792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7261f25d-354d-4f89-a27a-567431820ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:32.274269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1047/2108] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:31 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:32.295680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098088a-d466-41bc-8da7-6c749e252add admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:32.305081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261f25d-354d-4f89-a27a-567431820ac6 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:32.315730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:32.316670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.316898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.317251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] PATH_INFO: `/v3/projects/2ea05442a1b54ee7ae55229d3dae3dfb` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.318469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea05442a1b54ee7ae55229d3dae3dfb)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:32.321029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:32.329729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1098088a-d466-41bc-8da7-6c749e252add admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:32.343686 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7cab9-e6e0-4ae2-858b-43c8f14858ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:32.344243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7cab9-e6e0-4ae2-858b-43c8f14858ab admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.344873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7cab9-e6e0-4ae2-858b-43c8f14858ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.344873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c7cab9-e6e0-4ae2-858b-43c8f14858ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.345517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7cab9-e6e0-4ae2-858b-43c8f14858ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:32.348536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c7cab9-e6e0-4ae2-858b-43c8f14858ab admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:32.360166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1048/2109] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:32.364741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7cab9-e6e0-4ae2-858b-43c8f14858ab admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:32.375991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c7cab9-e6e0-4ae2-858b-43c8f14858ab admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:32.381832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b6143-7f7f-4fe9-8e67-a4e2f12388a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:32.382610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b6143-7f7f-4fe9-8e67-a4e2f12388a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.383053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b6143-7f7f-4fe9-8e67-a4e2f12388a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.383371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8b6143-7f7f-4fe9-8e67-a4e2f12388a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.384062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b6143-7f7f-4fe9-8e67-a4e2f12388a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:32.385720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8b6143-7f7f-4fe9-8e67-a4e2f12388a5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:32.396813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1049/2110] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:32.400908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b6143-7f7f-4fe9-8e67-a4e2f12388a5 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:32.410723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8b6143-7f7f-4fe9-8e67-a4e2f12388a5 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:32.415871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7987025d-86bc-4c48-8fb8-96bf114c0b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:32.416687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987025d-86bc-4c48-8fb8-96bf114c0b90 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.417024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987025d-86bc-4c48-8fb8-96bf114c0b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.425996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7987025d-86bc-4c48-8fb8-96bf114c0b90 admin admin] PATH_INFO: `/v3/projects/57aa11a6160541b59f79a4e4f70fac9b/users/06c3c6b8a87f437680efc9bd03d36b56/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.432468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987025d-86bc-4c48-8fb8-96bf114c0b90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57aa11a6160541b59f79a4e4f70fac9b, user_id=06c3c6b8a87f437680efc9bd03d36b56, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:32.435115 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7987025d-86bc-4c48-8fb8-96bf114c0b90 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:32.449833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:32.562259 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1050/2111] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:32 2022] PUT /identity/v3/projects/57aa11a6160541b59f79a4e4f70fac9b/users/06c3c6b8a87f437680efc9bd03d36b56/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:32.570368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea05442a1b54ee7ae55229d3dae3dfb', 'request_id': 'req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.572715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987417c9-4ed3-42f8-8f81-bfd6e506916c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.573009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987417c9-4ed3-42f8-8f81-bfd6e506916c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.573291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987417c9-4ed3-42f8-8f81-bfd6e506916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.609451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-987417c9-4ed3-42f8-8f81-bfd6e506916c None None] MFA Rules not processed for user `06c3c6b8a87f437680efc9bd03d36b56`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:32.609451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-987417c9-4ed3-42f8-8f81-bfd6e506916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:32.664842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea05442a1b54ee7ae55229d3dae3dfb', 'request_id': 'req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.671674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea05442a1b54ee7ae55229d3dae3dfb', 'request_id': 'req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.677321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1051/2112] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:32.678458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987417c9-4ed3-42f8-8f81-bfd6e506916c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:32.679778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-987417c9-4ed3-42f8-8f81-bfd6e506916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:32.686258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] The token cache is being invalidate because project 2ea05442a1b54ee7ae55229d3dae3dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:32.686258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.686854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:32.688606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1062/2113] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:32 2022] DELETE /identity/v3/projects/2ea05442a1b54ee7ae55229d3dae3dfb => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:32.690420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:32.691819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:32.752606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e76b619-bff2-4f39-a34c-c6fd7c3e4df9 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:32.753638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987417c9-4ed3-42f8-8f81-bfd6e506916c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:32.757868 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:32.758477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.758705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:32.758818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.759019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.759579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.759909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.760178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] PATH_INFO: `/v3/projects/3051ec8e2fe643fb8455e4e1263ab306` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.761059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:32.761276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3051ec8e2fe643fb8455e4e1263ab306)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:32.763574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:32.772969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:32.774665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:32.784514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1063/2114] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:32.785337 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:32.786654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:32.801813 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f26e4c-0660-4a38-b516-42631b3de400 service glance] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:32.806666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:32.807356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:32.807635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:32.807884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] PATH_INFO: `/v3/users/cb2ea3cb1f974b9c8d88738c3ab89a23` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:32.811276 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb2ea3cb1f974b9c8d88738c3ab89a23)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:32.812298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:33.000694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3051ec8e2fe643fb8455e4e1263ab306', 'request_id': 'req-eff0898a-c07e-4289-931f-d6281722fd2a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.090534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3051ec8e2fe643fb8455e4e1263ab306', 'request_id': 'req-eff0898a-c07e-4289-931f-d6281722fd2a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.097788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb2ea3cb1f974b9c8d88738c3ab89a23'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.102163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3051ec8e2fe643fb8455e4e1263ab306', 'request_id': 'req-eff0898a-c07e-4289-931f-d6281722fd2a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.105918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb2ea3cb1f974b9c8d88738c3ab89a23'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.106909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb2ea3cb1f974b9c8d88738c3ab89a23'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.107748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb2ea3cb1f974b9c8d88738c3ab89a23'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.114307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] The token cache is being invalidate because project 3051ec8e2fe643fb8455e4e1263ab306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:33.114589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.115703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.117410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1052/2115] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:32 2022] DELETE /identity/v3/projects/3051ec8e2fe643fb8455e4e1263ab306 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:33.121301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:33.122630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:33.181801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb2ea3cb1f974b9c8d88738c3ab89a23'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.195245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff0898a-c07e-4289-931f-d6281722fd2a admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:33.200733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:33.201446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:33.201795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:33.202140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] PATH_INFO: `/v3/users/f8c3f2d16de04c17809265681dc686d4` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:33.203435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8c3f2d16de04c17809265681dc686d4)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:33.205459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:33.211545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1064/2116] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:32 2022] DELETE /identity/v3/users/cb2ea3cb1f974b9c8d88738c3ab89a23 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:33.471475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8c3f2d16de04c17809265681dc686d4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.480081 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8c3f2d16de04c17809265681dc686d4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.480879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8c3f2d16de04c17809265681dc686d4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.482045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8c3f2d16de04c17809265681dc686d4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.568426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:33.610515 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-413ebc66-3af1-4b36-a59f-83cca2b98f65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8c3f2d16de04c17809265681dc686d4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:33.632344 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1053/2117] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:33 2022] DELETE /identity/v3/users/f8c3f2d16de04c17809265681dc686d4 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:33.729084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:33.730591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:33.813442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0642fca-b63f-4d0c-865f-8054f07c80d8 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:33.870483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:33.871113 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:33.871398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:33.871697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] PATH_INFO: `/v3/projects/b762a24358c148469afdab49e32b3ab1` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:33.872801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b762a24358c148469afdab49e32b3ab1)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:33.874742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:34.038797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b762a24358c148469afdab49e32b3ab1', 'request_id': 'req-32eb5d35-9d66-453c-9e71-823e84c97ca6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.169139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b762a24358c148469afdab49e32b3ab1', 'request_id': 'req-32eb5d35-9d66-453c-9e71-823e84c97ca6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.175986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b762a24358c148469afdab49e32b3ab1', 'request_id': 'req-32eb5d35-9d66-453c-9e71-823e84c97ca6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.186203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] The token cache is being invalidate because project b762a24358c148469afdab49e32b3ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:34.186497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.187133 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.188651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1065/2118] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:33 2022] DELETE /identity/v3/projects/b762a24358c148469afdab49e32b3ab1 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:34.194041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2414-198b-4b68-a8cc-d217d1323124 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.194390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2414-198b-4b68-a8cc-d217d1323124 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.194674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a2414-198b-4b68-a8cc-d217d1323124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.215106 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ce6a2414-198b-4b68-a8cc-d217d1323124 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:34.216365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ce6a2414-198b-4b68-a8cc-d217d1323124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:34.242353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:34.243793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:34.300276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1054/2119] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:34.310428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d699fd6-9f67-4ac1-9ae9-c87c8bdefecf None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.310985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d699fd6-9f67-4ac1-9ae9-c87c8bdefecf None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.311343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d699fd6-9f67-4ac1-9ae9-c87c8bdefecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.341119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8d699fd6-9f67-4ac1-9ae9-c87c8bdefecf None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:34.343545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8d699fd6-9f67-4ac1-9ae9-c87c8bdefecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:34.343667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eb5d35-9d66-453c-9e71-823e84c97ca6 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:34.351704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:34.352662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.353021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.353248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1055/2120] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:34.355704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] PATH_INFO: `/v3/projects/c3947e0c3d8f4627baacf4d814fdad83` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.358140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d699fd6-9f67-4ac1-9ae9-c87c8bdefecf None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:34.360627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3947e0c3d8f4627baacf4d814fdad83)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:34.365631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:34.378041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d699fd6-9f67-4ac1-9ae9-c87c8bdefecf None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:34.387614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c88a8-ea0e-4ea1-98fb-4cb197cbe522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:34.388507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c88a8-ea0e-4ea1-98fb-4cb197cbe522 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.388794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c88a8-ea0e-4ea1-98fb-4cb197cbe522 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.389120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c88a8-ea0e-4ea1-98fb-4cb197cbe522 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.390241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c88a8-ea0e-4ea1-98fb-4cb197cbe522 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:34.390802 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c88a8-ea0e-4ea1-98fb-4cb197cbe522 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:34.393617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c88a8-ea0e-4ea1-98fb-4cb197cbe522 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:34.456764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1056/2121] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:34.461153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c88a8-ea0e-4ea1-98fb-4cb197cbe522 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:34.475919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c88a8-ea0e-4ea1-98fb-4cb197cbe522 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:34.490142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4174a7-e34f-4f62-91d6-b614b94dc6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:34.491232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4174a7-e34f-4f62-91d6-b614b94dc6a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.491703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4174a7-e34f-4f62-91d6-b614b94dc6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.492339 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4174a7-e34f-4f62-91d6-b614b94dc6a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.493120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4174a7-e34f-4f62-91d6-b614b94dc6a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:34.495666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4174a7-e34f-4f62-91d6-b614b94dc6a3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:34.516678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3947e0c3d8f4627baacf4d814fdad83', 'request_id': 'req-1420c1df-bf31-4f99-bc10-bee121f320a9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.676702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3947e0c3d8f4627baacf4d814fdad83', 'request_id': 'req-1420c1df-bf31-4f99-bc10-bee121f320a9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.683588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3947e0c3d8f4627baacf4d814fdad83', 'request_id': 'req-1420c1df-bf31-4f99-bc10-bee121f320a9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.695679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] The token cache is being invalidate because project c3947e0c3d8f4627baacf4d814fdad83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:34.695679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.696159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1420c1df-bf31-4f99-bc10-bee121f320a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:34.697698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1066/2122] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:34 2022] DELETE /identity/v3/projects/c3947e0c3d8f4627baacf4d814fdad83 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:34.702267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff425c-a0a1-4d8d-9b75-4b8beea30714 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.702668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff425c-a0a1-4d8d-9b75-4b8beea30714 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.703029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff425c-a0a1-4d8d-9b75-4b8beea30714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.718312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1057/2123] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:34 2022] POST /identity/v3/projects => generated 367 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:34.723479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4174a7-e34f-4f62-91d6-b614b94dc6a3 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:34.725894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ac4174a7-e34f-4f62-91d6-b614b94dc6a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:34.748006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c8ff425c-a0a1-4d8d-9b75-4b8beea30714 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:34.750004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c8ff425c-a0a1-4d8d-9b75-4b8beea30714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:34.798067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4174a7-e34f-4f62-91d6-b614b94dc6a3 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:34.803449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80714ab9-9b96-47a7-89a0-45ca12c130c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:34.804680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80714ab9-9b96-47a7-89a0-45ca12c130c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.804680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80714ab9-9b96-47a7-89a0-45ca12c130c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.804680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80714ab9-9b96-47a7-89a0-45ca12c130c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.805241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80714ab9-9b96-47a7-89a0-45ca12c130c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:34.807290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80714ab9-9b96-47a7-89a0-45ca12c130c2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:34.823349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1067/2124] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:34.831455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fbcf1-ad65-4870-9099-d4c5d502ad3a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.832427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fbcf1-ad65-4870-9099-d4c5d502ad3a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.833141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fbcf1-ad65-4870-9099-d4c5d502ad3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.856820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-bf0fbcf1-ad65-4870-9099-d4c5d502ad3a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:34.858930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bf0fbcf1-ad65-4870-9099-d4c5d502ad3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:34.870874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1068/2125] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:34.876243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fbcf1-ad65-4870-9099-d4c5d502ad3a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:34.885656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fbcf1-ad65-4870-9099-d4c5d502ad3a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:34.890739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db94a16-2536-4061-a50e-7fcc5d82d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:34.891417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db94a16-2536-4061-a50e-7fcc5d82d33d admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.891769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db94a16-2536-4061-a50e-7fcc5d82d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.892048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db94a16-2536-4061-a50e-7fcc5d82d33d admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.892922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db94a16-2536-4061-a50e-7fcc5d82d33d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:34.893233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db94a16-2536-4061-a50e-7fcc5d82d33d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:34.895020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db94a16-2536-4061-a50e-7fcc5d82d33d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:34.923392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1069/2126] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:53:34.924975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db94a16-2536-4061-a50e-7fcc5d82d33d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:34.935462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db94a16-2536-4061-a50e-7fcc5d82d33d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:34.940608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b9aec-0d36-459b-a165-da39f16165ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:34.941284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b9aec-0d36-459b-a165-da39f16165ab admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.941633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b9aec-0d36-459b-a165-da39f16165ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.941945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b9aec-0d36-459b-a165-da39f16165ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.942639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b9aec-0d36-459b-a165-da39f16165ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:34.944723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b9aec-0d36-459b-a165-da39f16165ab admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:34.976596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1058/2127] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:34 2022] POST /identity/v3/users => generated 284 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:34.977596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80714ab9-9b96-47a7-89a0-45ca12c130c2 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:34.988919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80714ab9-9b96-47a7-89a0-45ca12c130c2 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:34.994370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcd5c7-3182-4562-bfba-e328fcc3279e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:34.998328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcd5c7-3182-4562-bfba-e328fcc3279e admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:34.998328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcd5c7-3182-4562-bfba-e328fcc3279e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:34.998328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcd5c7-3182-4562-bfba-e328fcc3279e admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:34.998328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcd5c7-3182-4562-bfba-e328fcc3279e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:34.998328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bcd5c7-3182-4562-bfba-e328fcc3279e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.012558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1059/2128] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:35.015286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcd5c7-3182-4562-bfba-e328fcc3279e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.026814 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcd5c7-3182-4562-bfba-e328fcc3279e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.032357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643507a2-7139-4411-8c6b-7a3433203a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.034634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643507a2-7139-4411-8c6b-7a3433203a7d admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.034634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643507a2-7139-4411-8c6b-7a3433203a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.034634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643507a2-7139-4411-8c6b-7a3433203a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.034912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643507a2-7139-4411-8c6b-7a3433203a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.036374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643507a2-7139-4411-8c6b-7a3433203a7d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.048346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1060/2129] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:35.052603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643507a2-7139-4411-8c6b-7a3433203a7d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.059475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:35.065981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643507a2-7139-4411-8c6b-7a3433203a7d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.069124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1070/2130] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:34 2022] POST /identity/v3/projects => generated 379 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:35.072910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b9aec-0d36-459b-a165-da39f16165ab admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.134573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2f800-2048-4ecb-a854-eb35e296b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.135948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2f800-2048-4ecb-a854-eb35e296b880 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.136260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2f800-2048-4ecb-a854-eb35e296b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.136572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2f800-2048-4ecb-a854-eb35e296b880 admin admin] PATH_INFO: `/v3/projects/3a597c58b1d643b79e16f68b3516c090/users/e7ef79abd66545c89e889f601b160b1c/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.143546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b9aec-0d36-459b-a165-da39f16165ab admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.148349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1194a-fb7a-4df3-8bba-8fe3d2a504db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.148957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1194a-fb7a-4df3-8bba-8fe3d2a504db admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.149412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1194a-fb7a-4df3-8bba-8fe3d2a504db admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.150069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a1194a-fb7a-4df3-8bba-8fe3d2a504db admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.150876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1194a-fb7a-4df3-8bba-8fe3d2a504db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.152642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2f800-2048-4ecb-a854-eb35e296b880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a597c58b1d643b79e16f68b3516c090, user_id=e7ef79abd66545c89e889f601b160b1c, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.153052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a1194a-fb7a-4df3-8bba-8fe3d2a504db admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.160902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2f800-2048-4ecb-a854-eb35e296b880 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.349693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1061/2131] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:35 2022] PUT /identity/v3/projects/3a597c58b1d643b79e16f68b3516c090/users/e7ef79abd66545c89e889f601b160b1c/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:35.362595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb97ba-8c87-4c25-9fc6-d7f97cfcced3 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.363045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb97ba-8c87-4c25-9fc6-d7f97cfcced3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.364103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbb97ba-8c87-4c25-9fc6-d7f97cfcced3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.368888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1071/2132] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:35 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:35.380992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1194a-fb7a-4df3-8bba-8fe3d2a504db admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.409507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a1194a-fb7a-4df3-8bba-8fe3d2a504db admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.409872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-fcbb97ba-8c87-4c25-9fc6-d7f97cfcced3 None None] MFA Rules not processed for user `e7ef79abd66545c89e889f601b160b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:35.410775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fcbb97ba-8c87-4c25-9fc6-d7f97cfcced3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:35.509018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc99e61-c4c0-4e45-9c80-1832a8f76748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.509863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc99e61-c4c0-4e45-9c80-1832a8f76748 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.510230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc99e61-c4c0-4e45-9c80-1832a8f76748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.510510 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc99e61-c4c0-4e45-9c80-1832a8f76748 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.511321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc99e61-c4c0-4e45-9c80-1832a8f76748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.513420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc99e61-c4c0-4e45-9c80-1832a8f76748 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.522984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1062/2133] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:35.526372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb97ba-8c87-4c25-9fc6-d7f97cfcced3 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.532432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1072/2134] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:35.535129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc99e61-c4c0-4e45-9c80-1832a8f76748 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.545945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbb97ba-8c87-4c25-9fc6-d7f97cfcced3 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.550389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc99e61-c4c0-4e45-9c80-1832a8f76748 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.550761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceaf93-4995-4d1a-b098-7037a65036d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.551377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceaf93-4995-4d1a-b098-7037a65036d3 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.551692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceaf93-4995-4d1a-b098-7037a65036d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.551971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deceaf93-4995-4d1a-b098-7037a65036d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.554391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceaf93-4995-4d1a-b098-7037a65036d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.554632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deceaf93-4995-4d1a-b098-7037a65036d3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.558579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d46c-78dd-4b5f-b99f-352bcdd00693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.559405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d46c-78dd-4b5f-b99f-352bcdd00693 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.559622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d46c-78dd-4b5f-b99f-352bcdd00693 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.559900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff1d46c-78dd-4b5f-b99f-352bcdd00693 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.560736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1d46c-78dd-4b5f-b99f-352bcdd00693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.566644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff1d46c-78dd-4b5f-b99f-352bcdd00693 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.579928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1073/2135] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:35.584825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d46c-78dd-4b5f-b99f-352bcdd00693 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.599684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff1d46c-78dd-4b5f-b99f-352bcdd00693 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.605402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fef93e-80e7-4db8-922f-9c0a4ee276b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.606310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fef93e-80e7-4db8-922f-9c0a4ee276b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.606660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fef93e-80e7-4db8-922f-9c0a4ee276b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.607000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fef93e-80e7-4db8-922f-9c0a4ee276b4 admin admin] PATH_INFO: `/v3/projects/fcb0f3844bda4224b61b5c693c188c6d/users/35e55fd86cda41d591d33705a34c7ef8/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.628585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fef93e-80e7-4db8-922f-9c0a4ee276b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcb0f3844bda4224b61b5c693c188c6d, user_id=35e55fd86cda41d591d33705a34c7ef8, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.631628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fef93e-80e7-4db8-922f-9c0a4ee276b4 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.710117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1063/2136] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:35 2022] POST /identity/v3/projects => generated 369 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:35.710117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceaf93-4995-4d1a-b098-7037a65036d3 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.714867 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-deceaf93-4995-4d1a-b098-7037a65036d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:35.748698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1074/2137] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:35 2022] PUT /identity/v3/projects/fcb0f3844bda4224b61b5c693c188c6d/users/35e55fd86cda41d591d33705a34c7ef8/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:35.750392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fef93e-80e7-4db8-922f-9c0a4ee276b4 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:35.824827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deceaf93-4995-4d1a-b098-7037a65036d3 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.856943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fef93e-80e7-4db8-922f-9c0a4ee276b4 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:35.863184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157d34c8-4227-4dc5-9f7e-424350512529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.863976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d34c8-4227-4dc5-9f7e-424350512529 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.873401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d34c8-4227-4dc5-9f7e-424350512529 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.873401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157d34c8-4227-4dc5-9f7e-424350512529 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.873401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d34c8-4227-4dc5-9f7e-424350512529 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.873401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157d34c8-4227-4dc5-9f7e-424350512529 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:35.901857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:35.902827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:35.903255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:35.903777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] PATH_INFO: `/v3/users/cd8839e41f2e460680a6d72b31229f15` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:35.905161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd8839e41f2e460680a6d72b31229f15)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:35.907255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.010362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:36.016485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1075/2138] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:35 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:36.017800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9cab8-870e-40fa-9cbb-1a43fb4e8115 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.018299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9cab8-870e-40fa-9cbb-1a43fb4e8115 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.018818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9cab8-870e-40fa-9cbb-1a43fb4e8115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.052218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-79b9cab8-870e-40fa-9cbb-1a43fb4e8115 None None] MFA Rules not processed for user `35e55fd86cda41d591d33705a34c7ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:36.053686 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-79b9cab8-870e-40fa-9cbb-1a43fb4e8115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:36.120167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1076/2139] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:36.121142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9cab8-870e-40fa-9cbb-1a43fb4e8115 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.131565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9cab8-870e-40fa-9cbb-1a43fb4e8115 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.136550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8182a7-91de-4eb8-8abd-ef6677af24dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.137283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8182a7-91de-4eb8-8abd-ef6677af24dd admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.137577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8182a7-91de-4eb8-8abd-ef6677af24dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.137853 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8182a7-91de-4eb8-8abd-ef6677af24dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.138505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8182a7-91de-4eb8-8abd-ef6677af24dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.140139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8182a7-91de-4eb8-8abd-ef6677af24dd admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.150023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1077/2140] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:36.150894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8182a7-91de-4eb8-8abd-ef6677af24dd admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.155875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd8839e41f2e460680a6d72b31229f15'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.161442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8182a7-91de-4eb8-8abd-ef6677af24dd admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.163941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd8839e41f2e460680a6d72b31229f15'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.164610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd8839e41f2e460680a6d72b31229f15'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.165226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd8839e41f2e460680a6d72b31229f15'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.172253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a2e88-2470-4ea7-91c7-b020b07e4f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.173026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a2e88-2470-4ea7-91c7-b020b07e4f48 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.173415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a2e88-2470-4ea7-91c7-b020b07e4f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.175569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a2e88-2470-4ea7-91c7-b020b07e4f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.175569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a2e88-2470-4ea7-91c7-b020b07e4f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.177664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a2e88-2470-4ea7-91c7-b020b07e4f48 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.287831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd8839e41f2e460680a6d72b31229f15'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:36.301468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1078/2141] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:36 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:36.302464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a2e88-2470-4ea7-91c7-b020b07e4f48 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.304704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2f5a2e88-2470-4ea7-91c7-b020b07e4f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:36.313423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1064/2142] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:35 2022] DELETE /identity/v3/users/cd8839e41f2e460680a6d72b31229f15 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:36.314215 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.317836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:36.396887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a2e88-2470-4ea7-91c7-b020b07e4f48 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.397112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914d395e-af04-4034-884a-3d3195f7c640 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.403119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597419-8440-4c17-98ca-46330c906397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.403796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597419-8440-4c17-98ca-46330c906397 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.404078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597419-8440-4c17-98ca-46330c906397 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.404357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d597419-8440-4c17-98ca-46330c906397 admin admin] PATH_INFO: `/v3/projects/56ffd543f4bf4254b83fa5f70eb551db/users/8dd9a99bd47045f696fbde6cd1f8c31f/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.406696 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8431e619-2fc9-4b70-b3d6-659e48b2034a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.407722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e619-2fc9-4b70-b3d6-659e48b2034a admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.408010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e619-2fc9-4b70-b3d6-659e48b2034a admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.409029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8431e619-2fc9-4b70-b3d6-659e48b2034a admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.409823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431e619-2fc9-4b70-b3d6-659e48b2034a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.413982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8431e619-2fc9-4b70-b3d6-659e48b2034a admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.424664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597419-8440-4c17-98ca-46330c906397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ffd543f4bf4254b83fa5f70eb551db, user_id=8dd9a99bd47045f696fbde6cd1f8c31f, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.427827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d597419-8440-4c17-98ca-46330c906397 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.587231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1065/2143] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:36 2022] POST /identity/v3/users => generated 289 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:36.595299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074108-019e-46b6-a821-db9b54aa7af5 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.596471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074108-019e-46b6-a821-db9b54aa7af5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.596872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54074108-019e-46b6-a821-db9b54aa7af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.616884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-54074108-019e-46b6-a821-db9b54aa7af5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:36.618199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-54074108-019e-46b6-a821-db9b54aa7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:36.630374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1066/2144] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:36.630374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54074108-019e-46b6-a821-db9b54aa7af5 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.637329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1079/2145] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:36 2022] PUT /identity/v3/projects/56ffd543f4bf4254b83fa5f70eb551db/users/8dd9a99bd47045f696fbde6cd1f8c31f/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:36.638465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597419-8440-4c17-98ca-46330c906397 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.639358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54074108-019e-46b6-a821-db9b54aa7af5 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.640672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9d597419-8440-4c17-98ca-46330c906397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:36.711137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d597419-8440-4c17-98ca-46330c906397 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.711426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d050442-ec04-448e-82dc-435eaf19d219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.712208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d050442-ec04-448e-82dc-435eaf19d219 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.712601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d050442-ec04-448e-82dc-435eaf19d219 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.712947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d050442-ec04-448e-82dc-435eaf19d219 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.713672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d050442-ec04-448e-82dc-435eaf19d219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.715561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47356-ea95-440f-b342-725c358d8619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.716112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d050442-ec04-448e-82dc-435eaf19d219 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.716556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47356-ea95-440f-b342-725c358d8619 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.717093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47356-ea95-440f-b342-725c358d8619 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.717817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f47356-ea95-440f-b342-725c358d8619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.731253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1067/2146] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:36.732786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d050442-ec04-448e-82dc-435eaf19d219 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.742058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f47356-ea95-440f-b342-725c358d8619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.745026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f47356-ea95-440f-b342-725c358d8619 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.751437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d050442-ec04-448e-82dc-435eaf19d219 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.762309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916872e9-fddc-42b0-9df7-2b55d9bfd029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.767064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916872e9-fddc-42b0-9df7-2b55d9bfd029 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.767064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916872e9-fddc-42b0-9df7-2b55d9bfd029 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.767064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916872e9-fddc-42b0-9df7-2b55d9bfd029 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.769094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916872e9-fddc-42b0-9df7-2b55d9bfd029 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.770317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1080/2147] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:36.772400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47356-ea95-440f-b342-725c358d8619 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.785582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916872e9-fddc-42b0-9df7-2b55d9bfd029 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.792699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f47356-ea95-440f-b342-725c358d8619 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.813157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1068/2148] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:36.814211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916872e9-fddc-42b0-9df7-2b55d9bfd029 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.823653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261c0b4-b7fb-41c0-8201-e658476db77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.824542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261c0b4-b7fb-41c0-8201-e658476db77e admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.824976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261c0b4-b7fb-41c0-8201-e658476db77e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.825912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261c0b4-b7fb-41c0-8201-e658476db77e admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.826733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261c0b4-b7fb-41c0-8201-e658476db77e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.831102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261c0b4-b7fb-41c0-8201-e658476db77e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.846829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1081/2149] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:36.851489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261c0b4-b7fb-41c0-8201-e658476db77e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:36.863881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261c0b4-b7fb-41c0-8201-e658476db77e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.867044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916872e9-fddc-42b0-9df7-2b55d9bfd029 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:36.869079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64dc28-5066-4fce-ab51-d90b01fb562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.869797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64dc28-5066-4fce-ab51-d90b01fb562a admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.870411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64dc28-5066-4fce-ab51-d90b01fb562a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.873783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64dc28-5066-4fce-ab51-d90b01fb562a admin admin] PATH_INFO: `/v3/projects/1dad3d66ba484182bec5c1375295aca8/users/d492ed90435c4ae39065cbd7fb849fa6/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.873924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569532e4-3b06-4e93-b6e6-281d86597c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:36.874754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569532e4-3b06-4e93-b6e6-281d86597c03 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.875500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569532e4-3b06-4e93-b6e6-281d86597c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.875921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569532e4-3b06-4e93-b6e6-281d86597c03 admin admin] PATH_INFO: `/v3/projects/56ffd543f4bf4254b83fa5f70eb551db/users/8dd9a99bd47045f696fbde6cd1f8c31f/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.880113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569532e4-3b06-4e93-b6e6-281d86597c03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ffd543f4bf4254b83fa5f70eb551db, user_id=8dd9a99bd47045f696fbde6cd1f8c31f, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.882780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569532e4-3b06-4e93-b6e6-281d86597c03 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.898312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1069/2150] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:36 2022] PUT /identity/v3/projects/56ffd543f4bf4254b83fa5f70eb551db/users/8dd9a99bd47045f696fbde6cd1f8c31f/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:36.909768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8f4c1-4b62-43bb-b04b-1d8810fad890 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:36.910177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8f4c1-4b62-43bb-b04b-1d8810fad890 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:36.910554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8f4c1-4b62-43bb-b04b-1d8810fad890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:36.918923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64dc28-5066-4fce-ab51-d90b01fb562a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dad3d66ba484182bec5c1375295aca8, user_id=d492ed90435c4ae39065cbd7fb849fa6, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:36.921720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64dc28-5066-4fce-ab51-d90b01fb562a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:36.945947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-d4f8f4c1-4b62-43bb-b04b-1d8810fad890 None None] MFA Rules not processed for user `8dd9a99bd47045f696fbde6cd1f8c31f`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:36.947323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d4f8f4c1-4b62-43bb-b04b-1d8810fad890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.015925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1082/2151] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:36 2022] PUT /identity/v3/projects/1dad3d66ba484182bec5c1375295aca8/users/d492ed90435c4ae39065cbd7fb849fa6/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:37.027340 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aab6e8-8085-41e0-a2d5-16b790625f0a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.028160 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aab6e8-8085-41e0-a2d5-16b790625f0a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.028947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aab6e8-8085-41e0-a2d5-16b790625f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.062999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1070/2152] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:36 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:37.079312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8f4c1-4b62-43bb-b04b-1d8810fad890 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.081514 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d4f8f4c1-4b62-43bb-b04b-1d8810fad890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.085452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-a9aab6e8-8085-41e0-a2d5-16b790625f0a None None] MFA Rules not processed for user `d492ed90435c4ae39065cbd7fb849fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:37.086931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a9aab6e8-8085-41e0-a2d5-16b790625f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.161269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8f4c1-4b62-43bb-b04b-1d8810fad890 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:37.186261 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1083/2153] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:37.187853 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aab6e8-8085-41e0-a2d5-16b790625f0a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.286162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aab6e8-8085-41e0-a2d5-16b790625f0a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:37.292661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee86f2-72cb-426d-af23-91a2924270fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:37.293600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee86f2-72cb-426d-af23-91a2924270fe admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.293890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee86f2-72cb-426d-af23-91a2924270fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.294408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee86f2-72cb-426d-af23-91a2924270fe admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.295053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee86f2-72cb-426d-af23-91a2924270fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:37.300533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccee86f2-72cb-426d-af23-91a2924270fe admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:37.346148 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25579e-044f-4ae5-9487-965d08554269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:37.346813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25579e-044f-4ae5-9487-965d08554269 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.348271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25579e-044f-4ae5-9487-965d08554269 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.348271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d25579e-044f-4ae5-9487-965d08554269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.410648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1084/2154] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:37 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:37.417975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee86f2-72cb-426d-af23-91a2924270fe admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.434191 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25579e-044f-4ae5-9487-965d08554269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:37.435797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d25579e-044f-4ae5-9487-965d08554269 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:37.448249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1071/2155] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:37 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:37.496372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:37.496537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee86f2-72cb-426d-af23-91a2924270fe admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:37.501205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b31a5-7cc2-45bd-b65f-70d664271f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:37.501904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b31a5-7cc2-45bd-b65f-70d664271f71 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.503104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b31a5-7cc2-45bd-b65f-70d664271f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.503587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1b31a5-7cc2-45bd-b65f-70d664271f71 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.504471 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b31a5-7cc2-45bd-b65f-70d664271f71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:37.506642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1b31a5-7cc2-45bd-b65f-70d664271f71 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:37.593406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25579e-044f-4ae5-9487-965d08554269 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.594506 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4d25579e-044f-4ae5-9487-965d08554269 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:37.613543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d25579e-044f-4ae5-9487-965d08554269 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:37.618487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:37.619234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.619887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.620071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] PATH_INFO: `/v3/projects/43eb09c4d12f418d8cc42699327fa4c6` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.621693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=43eb09c4d12f418d8cc42699327fa4c6)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:37.623714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:37.634793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1085/2156] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:37 2022] POST /identity/v3/users => generated 295 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:37.639380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b31a5-7cc2-45bd-b65f-70d664271f71 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.651227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1b31a5-7cc2-45bd-b65f-70d664271f71 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:37.664555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d848259-936d-44ce-a0a8-399006525113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:37.665301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d848259-936d-44ce-a0a8-399006525113 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.665650 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d848259-936d-44ce-a0a8-399006525113 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.665994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d848259-936d-44ce-a0a8-399006525113 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.666763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d848259-936d-44ce-a0a8-399006525113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:37.668542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d848259-936d-44ce-a0a8-399006525113 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:37.683752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1086/2157] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:37.684972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d848259-936d-44ce-a0a8-399006525113 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.695295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d848259-936d-44ce-a0a8-399006525113 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:37.700077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04507f0c-1d80-4f30-8aa3-dba11f2dd67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:37.700728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04507f0c-1d80-4f30-8aa3-dba11f2dd67f admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:37.701003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04507f0c-1d80-4f30-8aa3-dba11f2dd67f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:37.701269 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04507f0c-1d80-4f30-8aa3-dba11f2dd67f admin admin] PATH_INFO: `/v3/projects/6a3d73c4fab44de491746e3fa9709c69/users/b6a8ffbe72314107a27dd443e5ea3a0c/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:37.717012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04507f0c-1d80-4f30-8aa3-dba11f2dd67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3d73c4fab44de491746e3fa9709c69, user_id=b6a8ffbe72314107a27dd443e5ea3a0c, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:37.720372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04507f0c-1d80-4f30-8aa3-dba11f2dd67f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:37.855215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1087/2158] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:37 2022] PUT /identity/v3/projects/6a3d73c4fab44de491746e3fa9709c69/users/b6a8ffbe72314107a27dd443e5ea3a0c/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:37.859140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04507f0c-1d80-4f30-8aa3-dba11f2dd67f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:37.893563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43eb09c4d12f418d8cc42699327fa4c6', 'request_id': 'req-56b1d6df-122f-484f-8904-fe51f84577ff'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:37.943405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04507f0c-1d80-4f30-8aa3-dba11f2dd67f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.005658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cceaa-1bce-45de-9183-631550143130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.006275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cceaa-1bce-45de-9183-631550143130 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.006552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cceaa-1bce-45de-9183-631550143130 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.006823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36cceaa-1bce-45de-9183-631550143130 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.007469 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cceaa-1bce-45de-9183-631550143130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.009130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36cceaa-1bce-45de-9183-631550143130 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.019877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1088/2159] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:37 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:38.024212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cceaa-1bce-45de-9183-631550143130 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.035122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36cceaa-1bce-45de-9183-631550143130 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.040259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a2eb8c-0d9c-4233-bb36-1fb6f089caac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.040917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2eb8c-0d9c-4233-bb36-1fb6f089caac admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.041196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2eb8c-0d9c-4233-bb36-1fb6f089caac admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.041479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a2eb8c-0d9c-4233-bb36-1fb6f089caac admin admin] PATH_INFO: `/v3/projects/6a3d73c4fab44de491746e3fa9709c69/users/b6a8ffbe72314107a27dd443e5ea3a0c/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.043430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2eb8c-0d9c-4233-bb36-1fb6f089caac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a3d73c4fab44de491746e3fa9709c69, user_id=b6a8ffbe72314107a27dd443e5ea3a0c, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.046075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a2eb8c-0d9c-4233-bb36-1fb6f089caac admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.057862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1089/2160] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:38 2022] PUT /identity/v3/projects/6a3d73c4fab44de491746e3fa9709c69/users/b6a8ffbe72314107a27dd443e5ea3a0c/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:38.061590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43eb09c4d12f418d8cc42699327fa4c6', 'request_id': 'req-56b1d6df-122f-484f-8904-fe51f84577ff'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.068799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43eb09c4d12f418d8cc42699327fa4c6', 'request_id': 'req-56b1d6df-122f-484f-8904-fe51f84577ff'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.069075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c2db6-3abf-4045-804a-7e7a727fd297 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.069354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c2db6-3abf-4045-804a-7e7a727fd297 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.069642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5c2db6-3abf-4045-804a-7e7a727fd297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.086668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] The token cache is being invalidate because project 43eb09c4d12f418d8cc42699327fa4c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:38.086970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.089389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-56b1d6df-122f-484f-8904-fe51f84577ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:38.099167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1072/2161] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:37 2022] DELETE /identity/v3/projects/43eb09c4d12f418d8cc42699327fa4c6 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:38.100720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d0cd-2bf1-446d-a087-45a1cbfd6a5f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.101063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d0cd-2bf1-446d-a087-45a1cbfd6a5f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.103546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc90d0cd-2bf1-446d-a087-45a1cbfd6a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.105774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-bb5c2db6-3abf-4045-804a-7e7a727fd297 None None] MFA Rules not processed for user `b6a8ffbe72314107a27dd443e5ea3a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:38.107238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bb5c2db6-3abf-4045-804a-7e7a727fd297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:38.135252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-dc90d0cd-2bf1-446d-a087-45a1cbfd6a5f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:38.136510 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-dc90d0cd-2bf1-446d-a087-45a1cbfd6a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:38.188052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1090/2162] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:38.200035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c2db6-3abf-4045-804a-7e7a727fd297 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.201503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bb5c2db6-3abf-4045-804a-7e7a727fd297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:38.208368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1073/2163] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:38.216290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c91a17-6eaf-464d-bdf4-e9450b1672a7 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.216573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c91a17-6eaf-464d-bdf4-e9450b1672a7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.216846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c91a17-6eaf-464d-bdf4-e9450b1672a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.237132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-13c91a17-6eaf-464d-bdf4-e9450b1672a7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:38.238448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-13c91a17-6eaf-464d-bdf4-e9450b1672a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:38.246479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1074/2164] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:38.250479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c91a17-6eaf-464d-bdf4-e9450b1672a7 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.259476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c91a17-6eaf-464d-bdf4-e9450b1672a7 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.261287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5c2db6-3abf-4045-804a-7e7a727fd297 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.264607 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3be25-605e-495f-93f5-3427bad765a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.265025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53dc66-c12d-46f4-93d7-7ac266cb7ab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.265200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3be25-605e-495f-93f5-3427bad765a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.265476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3be25-605e-495f-93f5-3427bad765a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.265621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53dc66-c12d-46f4-93d7-7ac266cb7ab3 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.265732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3be25-605e-495f-93f5-3427bad765a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.265916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53dc66-c12d-46f4-93d7-7ac266cb7ab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.266186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53dc66-c12d-46f4-93d7-7ac266cb7ab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.266378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3be25-605e-495f-93f5-3427bad765a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:38.266711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3be25-605e-495f-93f5-3427bad765a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.268814 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3be25-605e-495f-93f5-3427bad765a5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.278906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53dc66-c12d-46f4-93d7-7ac266cb7ab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.280369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53dc66-c12d-46f4-93d7-7ac266cb7ab3 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.282273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1075/2165] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:53:38.287925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3be25-605e-495f-93f5-3427bad765a5 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.291271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1091/2166] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:38 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:38.297630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3be25-605e-495f-93f5-3427bad765a5 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.302464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb265f6-c784-4e02-868f-4c5ecb8223dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.303740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb265f6-c784-4e02-868f-4c5ecb8223dd admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.304014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb265f6-c784-4e02-868f-4c5ecb8223dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.304283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb265f6-c784-4e02-868f-4c5ecb8223dd admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.304962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb265f6-c784-4e02-868f-4c5ecb8223dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.306853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb265f6-c784-4e02-868f-4c5ecb8223dd admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.413619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:38.457132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1076/2167] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:38 2022] POST /identity/v3/projects => generated 385 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:38.460542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53dc66-c12d-46f4-93d7-7ac266cb7ab3 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.480517 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53dc66-c12d-46f4-93d7-7ac266cb7ab3 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.482449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb265f6-c784-4e02-868f-4c5ecb8223dd admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.555054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f747cd-f504-4273-82d6-3882dc741232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.555976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f747cd-f504-4273-82d6-3882dc741232 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.556323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f747cd-f504-4273-82d6-3882dc741232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.556651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f747cd-f504-4273-82d6-3882dc741232 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.557367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f747cd-f504-4273-82d6-3882dc741232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.559383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f747cd-f504-4273-82d6-3882dc741232 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.560496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb265f6-c784-4e02-868f-4c5ecb8223dd admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.564376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bddcf-3ae0-457d-b26f-762a08723384 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.565704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bddcf-3ae0-457d-b26f-762a08723384 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.565993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bddcf-3ae0-457d-b26f-762a08723384 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.566452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bddcf-3ae0-457d-b26f-762a08723384 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.568730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b87bddcf-3ae0-457d-b26f-762a08723384 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:38.630194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bddcf-3ae0-457d-b26f-762a08723384 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.631714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bddcf-3ae0-457d-b26f-762a08723384 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.640496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1077/2168] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:38.702481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1092/2169] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:38 2022] POST /identity/v3/users => generated 293 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:38.703655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bddcf-3ae0-457d-b26f-762a08723384 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.714690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bddcf-3ae0-457d-b26f-762a08723384 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.721641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9de0a-d058-4f3a-b415-a52a5d9e00d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.721641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9de0a-d058-4f3a-b415-a52a5d9e00d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.721641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9de0a-d058-4f3a-b415-a52a5d9e00d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.721641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9de0a-d058-4f3a-b415-a52a5d9e00d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.722435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9de0a-d058-4f3a-b415-a52a5d9e00d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.723761 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9de0a-d058-4f3a-b415-a52a5d9e00d0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.737985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1078/2170] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:38.739162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f747cd-f504-4273-82d6-3882dc741232 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.749211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f747cd-f504-4273-82d6-3882dc741232 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.754872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ccb4c-0121-4abb-bbec-fc934b3c18a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.755526 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ccb4c-0121-4abb-bbec-fc934b3c18a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.755819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ccb4c-0121-4abb-bbec-fc934b3c18a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.756096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ccb4c-0121-4abb-bbec-fc934b3c18a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.756768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ccb4c-0121-4abb-bbec-fc934b3c18a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.758593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ccb4c-0121-4abb-bbec-fc934b3c18a2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:38.769940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1093/2171] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:38.775830 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9de0a-d058-4f3a-b415-a52a5d9e00d0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:38.784869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9de0a-d058-4f3a-b415-a52a5d9e00d0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:38.789778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ecc9f-ee7f-40b8-be01-709ac3d0d938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:38.790514 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ecc9f-ee7f-40b8-be01-709ac3d0d938 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:38.790864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ecc9f-ee7f-40b8-be01-709ac3d0d938 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:38.791205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ecc9f-ee7f-40b8-be01-709ac3d0d938 admin admin] PATH_INFO: `/v3/projects/d26b37280b90491e9859c7bd4f875b4f/users/6e3583d081af4426aefd3ccd998f8314/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:38.811019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ecc9f-ee7f-40b8-be01-709ac3d0d938 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d26b37280b90491e9859c7bd4f875b4f, user_id=6e3583d081af4426aefd3ccd998f8314, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:38.814157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ecc9f-ee7f-40b8-be01-709ac3d0d938 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.031952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1079/2172] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:38 2022] PUT /identity/v3/projects/d26b37280b90491e9859c7bd4f875b4f/users/6e3583d081af4426aefd3ccd998f8314/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:39.043936 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915d7a-8f0b-4c8e-bc25-4734a465048e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.044463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915d7a-8f0b-4c8e-bc25-4734a465048e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.044575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1915d7a-8f0b-4c8e-bc25-4734a465048e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.080670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d1915d7a-8f0b-4c8e-bc25-4734a465048e None None] MFA Rules not processed for user `6e3583d081af4426aefd3ccd998f8314`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:39.081890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d1915d7a-8f0b-4c8e-bc25-4734a465048e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:39.178672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1094/2173] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:39.187891 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ecc9f-ee7f-40b8-be01-709ac3d0d938 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:39.270320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ecc9f-ee7f-40b8-be01-709ac3d0d938 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.274966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207077c-e614-4764-8947-4c9572c1acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.275602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207077c-e614-4764-8947-4c9572c1acff admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.275883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207077c-e614-4764-8947-4c9572c1acff admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.276182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2207077c-e614-4764-8947-4c9572c1acff admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.276794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207077c-e614-4764-8947-4c9572c1acff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.278812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2207077c-e614-4764-8947-4c9572c1acff admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.412608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1080/2174] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:39 2022] POST /identity/v3/projects => generated 383 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:39.418675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915d7a-8f0b-4c8e-bc25-4734a465048e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:39.431075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1915d7a-8f0b-4c8e-bc25-4734a465048e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.501799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a108bd0-8046-4cf7-bb55-cd6ec0368b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.502493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a108bd0-8046-4cf7-bb55-cd6ec0368b60 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.502775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a108bd0-8046-4cf7-bb55-cd6ec0368b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.503109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a108bd0-8046-4cf7-bb55-cd6ec0368b60 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.503970 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a108bd0-8046-4cf7-bb55-cd6ec0368b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.505947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a108bd0-8046-4cf7-bb55-cd6ec0368b60 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.638428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1095/2175] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:39 2022] POST /identity/v3/users => generated 292 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:39.642468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207077c-e614-4764-8947-4c9572c1acff admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:39.658545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2207077c-e614-4764-8947-4c9572c1acff admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.664768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875e32f-3364-4c6b-a76a-5ea8c3094cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.665598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e32f-3364-4c6b-a76a-5ea8c3094cb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.666010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e32f-3364-4c6b-a76a-5ea8c3094cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.666257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e32f-3364-4c6b-a76a-5ea8c3094cb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.667196 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875e32f-3364-4c6b-a76a-5ea8c3094cb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.673100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875e32f-3364-4c6b-a76a-5ea8c3094cb3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.690760 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a108bd0-8046-4cf7-bb55-cd6ec0368b60 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:39.701292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1081/2176] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:39.709341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a108bd0-8046-4cf7-bb55-cd6ec0368b60 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.720124 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32393a1-90aa-407f-9496-91af106cc93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.720780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32393a1-90aa-407f-9496-91af106cc93a admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.721055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32393a1-90aa-407f-9496-91af106cc93a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.722007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32393a1-90aa-407f-9496-91af106cc93a admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.722664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32393a1-90aa-407f-9496-91af106cc93a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.724314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32393a1-90aa-407f-9496-91af106cc93a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:39.735085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1096/2177] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:39.739887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875e32f-3364-4c6b-a76a-5ea8c3094cb3 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:39.750544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875e32f-3364-4c6b-a76a-5ea8c3094cb3 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:39.756201 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712a38-f3af-439f-bc1e-6913c759a7e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:39.756972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712a38-f3af-439f-bc1e-6913c759a7e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:39.757313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712a38-f3af-439f-bc1e-6913c759a7e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:39.757659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf712a38-f3af-439f-bc1e-6913c759a7e3 admin admin] PATH_INFO: `/v3/projects/5232077041a84df7ab4132aac0888ce2/users/5375f949e87a4bd7992ae725efabe76d/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:39.775798 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712a38-f3af-439f-bc1e-6913c759a7e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5232077041a84df7ab4132aac0888ce2, user_id=5375f949e87a4bd7992ae725efabe76d, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:39.779125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf712a38-f3af-439f-bc1e-6913c759a7e3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.028461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1082/2178] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:39 2022] PUT /identity/v3/projects/5232077041a84df7ab4132aac0888ce2/users/5375f949e87a4bd7992ae725efabe76d/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:40.042711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f952-672b-49cc-a37b-40af69e012a7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.043032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f952-672b-49cc-a37b-40af69e012a7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.043331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5587f952-672b-49cc-a37b-40af69e012a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.075886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-5587f952-672b-49cc-a37b-40af69e012a7 None None] MFA Rules not processed for user `5375f949e87a4bd7992ae725efabe76d`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:40.077243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-5587f952-672b-49cc-a37b-40af69e012a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:40.170456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1097/2179] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:40.175806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712a38-f3af-439f-bc1e-6913c759a7e3 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.248812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf712a38-f3af-439f-bc1e-6913c759a7e3 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:40.259065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ec38-105b-4e5e-9e08-d5a7270c789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:40.260112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ec38-105b-4e5e-9e08-d5a7270c789e admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.260969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ec38-105b-4e5e-9e08-d5a7270c789e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.261434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ec38-105b-4e5e-9e08-d5a7270c789e admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.262377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697ec38-105b-4e5e-9e08-d5a7270c789e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:40.264753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697ec38-105b-4e5e-9e08-d5a7270c789e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.395630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1083/2180] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:40 2022] POST /identity/v3/projects => generated 383 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:40.399908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f952-672b-49cc-a37b-40af69e012a7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.427031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5587f952-672b-49cc-a37b-40af69e012a7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:40.480848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:40.509632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3db2b9-405b-4047-9886-3177a7df3e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:40.510339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3db2b9-405b-4047-9886-3177a7df3e01 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.510690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3db2b9-405b-4047-9886-3177a7df3e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.511096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3db2b9-405b-4047-9886-3177a7df3e01 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.511859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3db2b9-405b-4047-9886-3177a7df3e01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:40.513801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3db2b9-405b-4047-9886-3177a7df3e01 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.666082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1098/2181] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:40 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:40.669597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ec38-105b-4e5e-9e08-d5a7270c789e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.697072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ec38-105b-4e5e-9e08-d5a7270c789e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:40.701541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaca1a9-3554-4bd9-9776-57ab5ca0b8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:40.702348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaca1a9-3554-4bd9-9776-57ab5ca0b8cb admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.702638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaca1a9-3554-4bd9-9776-57ab5ca0b8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.702912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaca1a9-3554-4bd9-9776-57ab5ca0b8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.703773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaca1a9-3554-4bd9-9776-57ab5ca0b8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:40.705346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaca1a9-3554-4bd9-9776-57ab5ca0b8cb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.723065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1084/2182] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:40.725746 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3db2b9-405b-4047-9886-3177a7df3e01 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.736601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3db2b9-405b-4047-9886-3177a7df3e01 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:40.743427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534fa44-e662-4aa3-a428-acd4119c8ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:40.744156 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534fa44-e662-4aa3-a428-acd4119c8ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:40.744437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534fa44-e662-4aa3-a428-acd4119c8ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:40.744716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1534fa44-e662-4aa3-a428-acd4119c8ceb admin admin] PATH_INFO: `/v3/projects/4387dd4a9b1f45e18a9528d6c8ea3249/users/f4a7bb1a8d264f6a8ee79315efaeb201/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:40.765078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534fa44-e662-4aa3-a428-acd4119c8ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=4387dd4a9b1f45e18a9528d6c8ea3249, user_id=f4a7bb1a8d264f6a8ee79315efaeb201, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:40.767942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1534fa44-e662-4aa3-a428-acd4119c8ceb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:40.957595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1099/2183] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:40 2022] PUT /identity/v3/projects/4387dd4a9b1f45e18a9528d6c8ea3249/users/f4a7bb1a8d264f6a8ee79315efaeb201/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:40.969222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaca1a9-3554-4bd9-9776-57ab5ca0b8cb admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:40.979941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaca1a9-3554-4bd9-9776-57ab5ca0b8cb admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:41.091623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78de4167-fc1d-4d06-95e2-d7f27b4432ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:41.093238 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de4167-fc1d-4d06-95e2-d7f27b4432ef admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:41.093596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de4167-fc1d-4d06-95e2-d7f27b4432ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:41.093942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78de4167-fc1d-4d06-95e2-d7f27b4432ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:41.095295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de4167-fc1d-4d06-95e2-d7f27b4432ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:41.097690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78de4167-fc1d-4d06-95e2-d7f27b4432ef admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:41.110150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1085/2184] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:41.115080 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534fa44-e662-4aa3-a428-acd4119c8ceb admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:41.135530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1534fa44-e662-4aa3-a428-acd4119c8ceb admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:41.140374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89677d-cf21-49ba-b6d0-6a9551dd3909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:41.141032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89677d-cf21-49ba-b6d0-6a9551dd3909 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:41.141312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89677d-cf21-49ba-b6d0-6a9551dd3909 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:41.141585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89677d-cf21-49ba-b6d0-6a9551dd3909 admin admin] PATH_INFO: `/v3/projects/4387dd4a9b1f45e18a9528d6c8ea3249/users/f4a7bb1a8d264f6a8ee79315efaeb201/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:41.144304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89677d-cf21-49ba-b6d0-6a9551dd3909 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4387dd4a9b1f45e18a9528d6c8ea3249, user_id=f4a7bb1a8d264f6a8ee79315efaeb201, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:41.147467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89677d-cf21-49ba-b6d0-6a9551dd3909 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:41.162679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1100/2185] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:41 2022] PUT /identity/v3/projects/4387dd4a9b1f45e18a9528d6c8ea3249/users/f4a7bb1a8d264f6a8ee79315efaeb201/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:41.174064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bcedb-c52d-4040-ac5b-29d7cb0f55e1 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:41.174526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bcedb-c52d-4040-ac5b-29d7cb0f55e1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:41.175047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5bcedb-c52d-4040-ac5b-29d7cb0f55e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:41.212522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ef5bcedb-c52d-4040-ac5b-29d7cb0f55e1 None None] MFA Rules not processed for user `f4a7bb1a8d264f6a8ee79315efaeb201`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:41.213831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ef5bcedb-c52d-4040-ac5b-29d7cb0f55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:41.305782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1086/2186] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:41 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:41.327749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89677d-cf21-49ba-b6d0-6a9551dd3909 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:41.329418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1b89677d-cf21-49ba-b6d0-6a9551dd3909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:41.411701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89677d-cf21-49ba-b6d0-6a9551dd3909 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:41.423632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=16,keystone:SELECT=79,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:41.429750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a93f9-1e5d-4f5f-b8c5-b8faeef3e054 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:41.430451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a93f9-1e5d-4f5f-b8c5-b8faeef3e054 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:41.430764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a93f9-1e5d-4f5f-b8c5-b8faeef3e054 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:41.435351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a93f9-1e5d-4f5f-b8c5-b8faeef3e054 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:41.587623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a93f9-1e5d-4f5f-b8c5-b8faeef3e054 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:41.602627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a93f9-1e5d-4f5f-b8c5-b8faeef3e054 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:41.620114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1101/2187] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:42.279729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:42.461227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bcedb-c52d-4040-ac5b-29d7cb0f55e1 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:42.462809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ef5bcedb-c52d-4040-ac5b-29d7cb0f55e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:42.533123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5bcedb-c52d-4040-ac5b-29d7cb0f55e1 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:42.538173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:42.538796 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:42.539073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:42.539342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] PATH_INFO: `/v3/users/e7ef79abd66545c89e889f601b160b1c` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:42.540606 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ef79abd66545c89e889f601b160b1c)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:42.542733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:42.958837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ef79abd66545c89e889f601b160b1c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:42.966455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ef79abd66545c89e889f601b160b1c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:42.972177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ef79abd66545c89e889f601b160b1c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:42.972177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ef79abd66545c89e889f601b160b1c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:43.144859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ef79abd66545c89e889f601b160b1c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:43.170071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1087/2188] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:42 2022] DELETE /identity/v3/users/e7ef79abd66545c89e889f601b160b1c => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:43.175486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1caea1-f0e3-48d6-93ce-08affdd45dd7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:43.176029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1caea1-f0e3-48d6-93ce-08affdd45dd7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:43.176125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1caea1-f0e3-48d6-93ce-08affdd45dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:43.195270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-6b1caea1-f0e3-48d6-93ce-08affdd45dd7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:43.196621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6b1caea1-f0e3-48d6-93ce-08affdd45dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:43.268207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1102/2189] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:43.280908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:43.283123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:43.368851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e66473a-fe6c-4fe5-9ba0-b75d4c0aea90 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:43.373843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ac1c5-c77c-46fd-8f32-5317c012bafd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:43.374677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ac1c5-c77c-46fd-8f32-5317c012bafd service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:43.375103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ac1c5-c77c-46fd-8f32-5317c012bafd service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:43.375378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7ac1c5-c77c-46fd-8f32-5317c012bafd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:43.386159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ac1c5-c77c-46fd-8f32-5317c012bafd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:43.387615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7ac1c5-c77c-46fd-8f32-5317c012bafd service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:43.398690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1088/2190] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:43.675488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03784a-0f01-4049-86a3-f8835ce9efe3 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:43.675839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03784a-0f01-4049-86a3-f8835ce9efe3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:43.676081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca03784a-0f01-4049-86a3-f8835ce9efe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:43.713157 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ca03784a-0f01-4049-86a3-f8835ce9efe3 None None] MFA Rules not processed for user `b9aef63cad18473994760d8bbc6faae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:43.715652 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ca03784a-0f01-4049-86a3-f8835ce9efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:43.820187 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1103/2191] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:43.969659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ac1c5-c77c-46fd-8f32-5317c012bafd service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:43.971165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ea7ac1c5-c77c-46fd-8f32-5317c012bafd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.037039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7ac1c5-c77c-46fd-8f32-5317c012bafd service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:44.040993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:44.041608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.041890 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.042163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.043929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.097496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03784a-0f01-4049-86a3-f8835ce9efe3 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:44.097496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ca03784a-0f01-4049-86a3-f8835ce9efe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.103004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca03784a-0f01-4049-86a3-f8835ce9efe3 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:44.108156 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:44.108881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.109231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.109511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] PATH_INFO: `/v3/users/35e55fd86cda41d591d33705a34c7ef8` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.110841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35e55fd86cda41d591d33705a34c7ef8)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:44.113060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:44.144351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:44.145822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:44.165265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1089/2192] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:44.168078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:44.171245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.201505 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14529cf-137f-4984-b5f1-5075e18b6d21 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:44.219763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:44.223079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.223428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.223800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] PATH_INFO: `/v3/projects/3a597c58b1d643b79e16f68b3516c090` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.225370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a597c58b1d643b79e16f68b3516c090)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:44.227393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:44.356668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35e55fd86cda41d591d33705a34c7ef8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.363727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35e55fd86cda41d591d33705a34c7ef8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.364400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35e55fd86cda41d591d33705a34c7ef8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.365186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35e55fd86cda41d591d33705a34c7ef8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.421165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a597c58b1d643b79e16f68b3516c090', 'request_id': 'req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.468090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-071a81a6-1fdb-4dac-b3b1-26825d7c6509 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35e55fd86cda41d591d33705a34c7ef8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.486817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1104/2193] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:44 2022] DELETE /identity/v3/users/35e55fd86cda41d591d33705a34c7ef8 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:44.490965 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef68002-b84f-4db1-8790-4b587a3e1f75 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.491253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef68002-b84f-4db1-8790-4b587a3e1f75 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.491550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef68002-b84f-4db1-8790-4b587a3e1f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.510982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-cef68002-b84f-4db1-8790-4b587a3e1f75 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:44.512191 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cef68002-b84f-4db1-8790-4b587a3e1f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.547797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a597c58b1d643b79e16f68b3516c090', 'request_id': 'req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.556098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a597c58b1d643b79e16f68b3516c090', 'request_id': 'req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.576550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] The token cache is being invalidate because project 3a597c58b1d643b79e16f68b3516c090 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:44.577075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.578455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:44.582015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1090/2194] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:44 2022] DELETE /identity/v3/projects/3a597c58b1d643b79e16f68b3516c090 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:44.586120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:44.593590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1105/2195] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:44.593757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.603493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef68002-b84f-4db1-8790-4b587a3e1f75 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:44.604958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cef68002-b84f-4db1-8790-4b587a3e1f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:44.675079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef68002-b84f-4db1-8790-4b587a3e1f75 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:44.681953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a4cf1-7756-40f4-9364-676818006f0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:44.682726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a4cf1-7756-40f4-9364-676818006f0f service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.683413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a4cf1-7756-40f4-9364-676818006f0f service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.683836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037a4cf1-7756-40f4-9364-676818006f0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.696329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a4cf1-7756-40f4-9364-676818006f0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:44.697806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7fc5d-4c2b-44a4-8442-d3e53c5dbf81 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:44.705065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037a4cf1-7756-40f4-9364-676818006f0f service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:44.709354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:44.710001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:44.710279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:44.710551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] PATH_INFO: `/v3/users/8dd9a99bd47045f696fbde6cd1f8c31f` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:44.711307 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1106/2196] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:44.712323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dd9a99bd47045f696fbde6cd1f8c31f)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:44.714466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:45.149199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dd9a99bd47045f696fbde6cd1f8c31f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.156504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dd9a99bd47045f696fbde6cd1f8c31f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.157401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dd9a99bd47045f696fbde6cd1f8c31f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.158040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dd9a99bd47045f696fbde6cd1f8c31f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.256373 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dd9a99bd47045f696fbde6cd1f8c31f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.276658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1091/2197] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:44 2022] DELETE /identity/v3/users/8dd9a99bd47045f696fbde6cd1f8c31f => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:45.434822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a4cf1-7756-40f4-9364-676818006f0f service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:45.436951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-037a4cf1-7756-40f4-9364-676818006f0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:45.462549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037a4cf1-7756-40f4-9364-676818006f0f service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:45.544774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:45.545489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:45.545854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:45.546135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] PATH_INFO: `/v3/projects/fcb0f3844bda4224b61b5c693c188c6d` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:45.547262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcb0f3844bda4224b61b5c693c188c6d)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:45.549251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:45.717040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcb0f3844bda4224b61b5c693c188c6d', 'request_id': 'req-323b605c-7839-47ff-b878-8e57961bf28d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.799826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:45.890932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcb0f3844bda4224b61b5c693c188c6d', 'request_id': 'req-323b605c-7839-47ff-b878-8e57961bf28d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.900429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcb0f3844bda4224b61b5c693c188c6d', 'request_id': 'req-323b605c-7839-47ff-b878-8e57961bf28d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.914438 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] The token cache is being invalidate because project fcb0f3844bda4224b61b5c693c188c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:45.914835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.915498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:45.917496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1107/2198] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:45 2022] DELETE /identity/v3/projects/fcb0f3844bda4224b61b5c693c188c6d => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:45.921415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:45.924533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:45.940935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc1226-bc0a-405d-b953-f1e186d27f1c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:45.946107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:45.947724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:46.043397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323b605c-7839-47ff-b878-8e57961bf28d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:46.049123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:46.049863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:46.050150 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:46.050471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] PATH_INFO: `/v3/users/d492ed90435c4ae39065cbd7fb849fa6` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:46.051378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:46.051925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d492ed90435c4ae39065cbd7fb849fa6)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:46.052312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:46.052597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:46.052878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] PATH_INFO: `/v3/projects/56ffd543f4bf4254b83fa5f70eb551db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:46.054050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:46.054162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ffd543f4bf4254b83fa5f70eb551db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:46.056183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:46.134818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:46.269940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd492ed90435c4ae39065cbd7fb849fa6'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.274892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ffd543f4bf4254b83fa5f70eb551db', 'request_id': 'req-d3896e2f-c3df-422c-aac0-5b4dba55f843'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.278146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd492ed90435c4ae39065cbd7fb849fa6'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.279656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd492ed90435c4ae39065cbd7fb849fa6'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.280428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd492ed90435c4ae39065cbd7fb849fa6'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.393663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ffd543f4bf4254b83fa5f70eb551db', 'request_id': 'req-d3896e2f-c3df-422c-aac0-5b4dba55f843'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.403397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ffd543f4bf4254b83fa5f70eb551db', 'request_id': 'req-d3896e2f-c3df-422c-aac0-5b4dba55f843'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.412056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] The token cache is being invalidate because project 56ffd543f4bf4254b83fa5f70eb551db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:46.412394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.413065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.414564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1108/2199] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:45 2022] DELETE /identity/v3/projects/56ffd543f4bf4254b83fa5f70eb551db => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:46.419411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:46.419411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:46.456488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7e95e754-cbb9-4fd0-8b0c-f612b3822dd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd492ed90435c4ae39065cbd7fb849fa6'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:46.478241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1092/2200] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:45 2022] DELETE /identity/v3/users/d492ed90435c4ae39065cbd7fb849fa6 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:46.479627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a084d-ca3a-4e74-a4dc-f53e57859ac3 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:46.479969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a084d-ca3a-4e74-a4dc-f53e57859ac3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:46.480246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676a084d-ca3a-4e74-a4dc-f53e57859ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:46.498422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3896e2f-c3df-422c-aac0-5b4dba55f843 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:46.510261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-676a084d-ca3a-4e74-a4dc-f53e57859ac3 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:46.511580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-676a084d-ca3a-4e74-a4dc-f53e57859ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:46.559114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcba31-9829-454b-805d-dedfbfbe509d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:46.560682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcba31-9829-454b-805d-dedfbfbe509d service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:46.561041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcba31-9829-454b-805d-dedfbfbe509d service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:46.561367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcba31-9829-454b-805d-dedfbfbe509d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:46.564272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-50dcba31-9829-454b-805d-dedfbfbe509d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:46.616177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1093/2201] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:46.623434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294104e-0d01-4da9-aee0-672cbd1cb35c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:46.623864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294104e-0d01-4da9-aee0-672cbd1cb35c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:46.624310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294104e-0d01-4da9-aee0-672cbd1cb35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:46.647340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a294104e-0d01-4da9-aee0-672cbd1cb35c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:46.648619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a294104e-0d01-4da9-aee0-672cbd1cb35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:46.656860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1094/2202] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:46.661494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294104e-0d01-4da9-aee0-672cbd1cb35c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:46.666728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcba31-9829-454b-805d-dedfbfbe509d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:46.668231 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcba31-9829-454b-805d-dedfbfbe509d service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:46.670244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294104e-0d01-4da9-aee0-672cbd1cb35c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:46.675468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab517bb-7c94-4cd0-a084-c5b74e322658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:46.676086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab517bb-7c94-4cd0-a084-c5b74e322658 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:46.676393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab517bb-7c94-4cd0-a084-c5b74e322658 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:46.676670 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab517bb-7c94-4cd0-a084-c5b74e322658 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:46.677311 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab517bb-7c94-4cd0-a084-c5b74e322658 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:46.677615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab517bb-7c94-4cd0-a084-c5b74e322658 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:46.678531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1109/2203] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:46 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:46.679226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab517bb-7c94-4cd0-a084-c5b74e322658 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:46.691969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1095/2204] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:53:46.696032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcba31-9829-454b-805d-dedfbfbe509d service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:46.707235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcba31-9829-454b-805d-dedfbfbe509d service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:46.712581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26086b8-e48c-4ca1-9229-f4ee81e4c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:46.713195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26086b8-e48c-4ca1-9229-f4ee81e4c57e admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:46.713479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26086b8-e48c-4ca1-9229-f4ee81e4c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:46.713758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26086b8-e48c-4ca1-9229-f4ee81e4c57e admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:46.714466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26086b8-e48c-4ca1-9229-f4ee81e4c57e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:46.717310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26086b8-e48c-4ca1-9229-f4ee81e4c57e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:46.869152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1110/2205] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:46 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:46.872070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab517bb-7c94-4cd0-a084-c5b74e322658 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:46.882128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab517bb-7c94-4cd0-a084-c5b74e322658 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:46.937808 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2943a9-e1c8-4ee9-94de-d1d1ad0b427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:46.938415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2943a9-e1c8-4ee9-94de-d1d1ad0b427a admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:46.938692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2943a9-e1c8-4ee9-94de-d1d1ad0b427a admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:46.938965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2943a9-e1c8-4ee9-94de-d1d1ad0b427a admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:46.939620 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2943a9-e1c8-4ee9-94de-d1d1ad0b427a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:46.941503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2943a9-e1c8-4ee9-94de-d1d1ad0b427a admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:46.952549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26086b8-e48c-4ca1-9229-f4ee81e4c57e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:46.954401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a26086b8-e48c-4ca1-9229-f4ee81e4c57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:46.968386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26086b8-e48c-4ca1-9229-f4ee81e4c57e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:46.973879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:46.974515 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:46.974799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:46.975082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] PATH_INFO: `/v3/projects/1dad3d66ba484182bec5c1375295aca8` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:46.976258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dad3d66ba484182bec5c1375295aca8)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:46.978182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:47.069589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1096/2206] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:46 2022] POST /identity/v3/users => generated 290 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:47.074378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2943a9-e1c8-4ee9-94de-d1d1ad0b427a admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:47.083980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2943a9-e1c8-4ee9-94de-d1d1ad0b427a admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:47.089203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70552e0-e0c1-43ba-9b63-3e36a9cbf858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:47.090264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70552e0-e0c1-43ba-9b63-3e36a9cbf858 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:47.090264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70552e0-e0c1-43ba-9b63-3e36a9cbf858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:47.090852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70552e0-e0c1-43ba-9b63-3e36a9cbf858 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:47.091701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70552e0-e0c1-43ba-9b63-3e36a9cbf858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:47.093540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70552e0-e0c1-43ba-9b63-3e36a9cbf858 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:47.104492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1097/2207] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:47.108423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70552e0-e0c1-43ba-9b63-3e36a9cbf858 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:47.113399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dad3d66ba484182bec5c1375295aca8', 'request_id': 'req-ab409762-cfb7-4bf4-a38d-27f569e0c130'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.120969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70552e0-e0c1-43ba-9b63-3e36a9cbf858 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:47.189986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771e89d-f111-4ae2-90a8-eee99c608136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:47.191216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771e89d-f111-4ae2-90a8-eee99c608136 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:47.191633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771e89d-f111-4ae2-90a8-eee99c608136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:47.191813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771e89d-f111-4ae2-90a8-eee99c608136 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:47.192640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771e89d-f111-4ae2-90a8-eee99c608136 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:47.194015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dad3d66ba484182bec5c1375295aca8', 'request_id': 'req-ab409762-cfb7-4bf4-a38d-27f569e0c130'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.194824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771e89d-f111-4ae2-90a8-eee99c608136 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:47.206295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1098/2208] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:47.206728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dad3d66ba484182bec5c1375295aca8', 'request_id': 'req-ab409762-cfb7-4bf4-a38d-27f569e0c130'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.210464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771e89d-f111-4ae2-90a8-eee99c608136 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:47.224243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771e89d-f111-4ae2-90a8-eee99c608136 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:47.235427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] The token cache is being invalidate because project 1dad3d66ba484182bec5c1375295aca8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:47.235805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.244018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.244018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1111/2209] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:46 2022] DELETE /identity/v3/projects/1dad3d66ba484182bec5c1375295aca8 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:47.244420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b832a3eb-eca7-4117-b01f-8af35fc05d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:47.244420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832a3eb-eca7-4117-b01f-8af35fc05d8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:47.244420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832a3eb-eca7-4117-b01f-8af35fc05d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:47.244420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b832a3eb-eca7-4117-b01f-8af35fc05d8d admin admin] PATH_INFO: `/v3/projects/363e531dd8134c48b6a8b71f9b1127f4/users/29a21f4f629a4e118234b5168b9c90ec/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:47.247598 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:47.249274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:47.259709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832a3eb-eca7-4117-b01f-8af35fc05d8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=363e531dd8134c48b6a8b71f9b1127f4, user_id=29a21f4f629a4e118234b5168b9c90ec, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:47.262571 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b832a3eb-eca7-4117-b01f-8af35fc05d8d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:47.263181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab409762-cfb7-4bf4-a38d-27f569e0c130 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:47.267990 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:47.268649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:47.268954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:47.269228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] PATH_INFO: `/v3/users/b6a8ffbe72314107a27dd443e5ea3a0c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:47.270405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6a8ffbe72314107a27dd443e5ea3a0c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:47.272317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:47.327245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1099/2210] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:47 2022] PUT /identity/v3/projects/363e531dd8134c48b6a8b71f9b1127f4/users/29a21f4f629a4e118234b5168b9c90ec/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:47.337950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b1109-e3de-44b4-993f-597253b545ad None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:47.338309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b1109-e3de-44b4-993f-597253b545ad None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:47.338663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b1109-e3de-44b4-993f-597253b545ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:47.371987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-272b1109-e3de-44b4-993f-597253b545ad None None] MFA Rules not processed for user `29a21f4f629a4e118234b5168b9c90ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:47.373227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-272b1109-e3de-44b4-993f-597253b545ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:47.458400 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6a8ffbe72314107a27dd443e5ea3a0c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.478920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6a8ffbe72314107a27dd443e5ea3a0c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.481872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6a8ffbe72314107a27dd443e5ea3a0c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.482498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6a8ffbe72314107a27dd443e5ea3a0c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.488728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1100/2211] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:47.495428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b1109-e3de-44b4-993f-597253b545ad None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:47.500506 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-272b1109-e3de-44b4-993f-597253b545ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:47.575050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b1109-e3de-44b4-993f-597253b545ad None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:47.579939 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5321f-99c5-467b-9fc4-f16b5df607df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:47.580549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5321f-99c5-467b-9fc4-f16b5df607df admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:47.580893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5321f-99c5-467b-9fc4-f16b5df607df admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:47.581167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f5321f-99c5-467b-9fc4-f16b5df607df admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:47.581803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5321f-99c5-467b-9fc4-f16b5df607df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:47.587973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6a8ffbe72314107a27dd443e5ea3a0c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:47.589280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f5321f-99c5-467b-9fc4-f16b5df607df admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:47.611405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1112/2212] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:47 2022] DELETE /identity/v3/users/b6a8ffbe72314107a27dd443e5ea3a0c => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:47.711768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1101/2213] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:47 2022] POST /identity/v3/projects => generated 377 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:47.715810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:47.717242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:47.788047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966045e5-30a4-495f-a439-6b51137688a2 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:47.851220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740946e-3971-407f-8403-b8386292a592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:47.851942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740946e-3971-407f-8403-b8386292a592 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:47.852385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740946e-3971-407f-8403-b8386292a592 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:47.852712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b740946e-3971-407f-8403-b8386292a592 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:47.853885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740946e-3971-407f-8403-b8386292a592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:47.855772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b740946e-3971-407f-8403-b8386292a592 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:47.965537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1113/2214] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:47 2022] POST /identity/v3/users => generated 295 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:47.970072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5321f-99c5-467b-9fc4-f16b5df607df admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:47.981724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f5321f-99c5-467b-9fc4-f16b5df607df admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:47.989261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338e1f2-629d-4400-909a-eede4391d519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:47.990119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e1f2-629d-4400-909a-eede4391d519 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:47.990397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e1f2-629d-4400-909a-eede4391d519 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:47.990683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338e1f2-629d-4400-909a-eede4391d519 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:47.991452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338e1f2-629d-4400-909a-eede4391d519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:47.993596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338e1f2-629d-4400-909a-eede4391d519 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:48.006851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1102/2215] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:48.008375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740946e-3971-407f-8403-b8386292a592 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:48.019937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b740946e-3971-407f-8403-b8386292a592 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:48.024842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d082846-8188-4efc-a67e-f28fb198667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:48.025565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d082846-8188-4efc-a67e-f28fb198667e admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.025794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d082846-8188-4efc-a67e-f28fb198667e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.026072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d082846-8188-4efc-a67e-f28fb198667e admin admin] PATH_INFO: `/v3/projects/ab3f03402c0b48e1b45b82f0eb46eaac/users/b8fbebbb38f746e28a6fa0ea56a47fdd/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.043199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d082846-8188-4efc-a67e-f28fb198667e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3f03402c0b48e1b45b82f0eb46eaac, user_id=b8fbebbb38f746e28a6fa0ea56a47fdd, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:48.048160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338e1f2-629d-4400-909a-eede4391d519 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:48.049333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d082846-8188-4efc-a67e-f28fb198667e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:48.051412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e338e1f2-629d-4400-909a-eede4391d519 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:48.071042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338e1f2-629d-4400-909a-eede4391d519 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:48.084272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:48.085795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.086176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.086621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] PATH_INFO: `/v3/projects/6a3d73c4fab44de491746e3fa9709c69` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.088420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a3d73c4fab44de491746e3fa9709c69)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:48.091595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:48.142017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1114/2216] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:48 2022] PUT /identity/v3/projects/ab3f03402c0b48e1b45b82f0eb46eaac/users/b8fbebbb38f746e28a6fa0ea56a47fdd/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:48.145955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d082846-8188-4efc-a67e-f28fb198667e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:48.214479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d082846-8188-4efc-a67e-f28fb198667e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:48.219645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e701793-6683-42c6-b050-2c37ff1d5292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:48.220253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e701793-6683-42c6-b050-2c37ff1d5292 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.220531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e701793-6683-42c6-b050-2c37ff1d5292 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.220869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e701793-6683-42c6-b050-2c37ff1d5292 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.221522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e701793-6683-42c6-b050-2c37ff1d5292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:48.223201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e701793-6683-42c6-b050-2c37ff1d5292 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:48.236351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1115/2217] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:48.237456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e701793-6683-42c6-b050-2c37ff1d5292 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:48.247209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:48.250657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e701793-6683-42c6-b050-2c37ff1d5292 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:48.254322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a3d73c4fab44de491746e3fa9709c69', 'request_id': 'req-6055f679-d462-4d0d-a7f0-735881d9d506'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:48.325826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb7b02-cd9b-434f-a795-0d0a4796fc48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:48.325826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb7b02-cd9b-434f-a795-0d0a4796fc48 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.326286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb7b02-cd9b-434f-a795-0d0a4796fc48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.326286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb7b02-cd9b-434f-a795-0d0a4796fc48 admin admin] PATH_INFO: `/v3/projects/ab3f03402c0b48e1b45b82f0eb46eaac/users/b8fbebbb38f746e28a6fa0ea56a47fdd/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.328580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb7b02-cd9b-434f-a795-0d0a4796fc48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab3f03402c0b48e1b45b82f0eb46eaac, user_id=b8fbebbb38f746e28a6fa0ea56a47fdd, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:48.331912 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb7b02-cd9b-434f-a795-0d0a4796fc48 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:48.342727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1116/2218] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:48 2022] PUT /identity/v3/projects/ab3f03402c0b48e1b45b82f0eb46eaac/users/b8fbebbb38f746e28a6fa0ea56a47fdd/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:48.353621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111564-43e9-46c9-9607-02d619c417a7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.353907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111564-43e9-46c9-9607-02d619c417a7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.354178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e111564-43e9-46c9-9607-02d619c417a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.370092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a3d73c4fab44de491746e3fa9709c69', 'request_id': 'req-6055f679-d462-4d0d-a7f0-735881d9d506'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:48.379602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a3d73c4fab44de491746e3fa9709c69', 'request_id': 'req-6055f679-d462-4d0d-a7f0-735881d9d506'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:48.384415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-0e111564-43e9-46c9-9607-02d619c417a7 None None] MFA Rules not processed for user `b8fbebbb38f746e28a6fa0ea56a47fdd`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:48.385670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0e111564-43e9-46c9-9607-02d619c417a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:48.393007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] The token cache is being invalidate because project 6a3d73c4fab44de491746e3fa9709c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:48.394087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:48.395072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6055f679-d462-4d0d-a7f0-735881d9d506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:48.397064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1103/2219] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:48 2022] DELETE /identity/v3/projects/6a3d73c4fab44de491746e3fa9709c69 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:48.414366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392d61b-5a36-48e9-b9a5-97ea4841ed92 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.418995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392d61b-5a36-48e9-b9a5-97ea4841ed92 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.420107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8392d61b-5a36-48e9-b9a5-97ea4841ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.473393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8392d61b-5a36-48e9-b9a5-97ea4841ed92 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:48.475379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8392d61b-5a36-48e9-b9a5-97ea4841ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:48.488623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1117/2220] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:53:48.500741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111564-43e9-46c9-9607-02d619c417a7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:48.503444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0e111564-43e9-46c9-9607-02d619c417a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:48.594593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1104/2221] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:48.601710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a3b6-10e9-45a7-8522-a5fedb92c367 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.601994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a3b6-10e9-45a7-8522-a5fedb92c367 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.602268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e73a3b6-10e9-45a7-8522-a5fedb92c367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.638723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e111564-43e9-46c9-9607-02d619c417a7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:48.642956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b61aa9-3cd7-4135-aaac-6a18bd272dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:48.644139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61aa9-3cd7-4135-aaac-6a18bd272dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.650101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61aa9-3cd7-4135-aaac-6a18bd272dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.650101 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b61aa9-3cd7-4135-aaac-6a18bd272dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.650470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-4e73a3b6-10e9-45a7-8522-a5fedb92c367 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:48.651117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-11b61aa9-3cd7-4135-aaac-6a18bd272dc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:48.653071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4e73a3b6-10e9-45a7-8522-a5fedb92c367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:48.679589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1105/2222] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:48.682139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a3b6-10e9-45a7-8522-a5fedb92c367 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:48.696687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e73a3b6-10e9-45a7-8522-a5fedb92c367 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:48.702675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448063-199e-4518-be64-3287832699da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:48.703307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448063-199e-4518-be64-3287832699da admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.703632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448063-199e-4518-be64-3287832699da admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.703959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71448063-199e-4518-be64-3287832699da admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.704621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448063-199e-4518-be64-3287832699da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:48.704929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448063-199e-4518-be64-3287832699da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:48.707088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71448063-199e-4518-be64-3287832699da admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:48.723345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1106/2223] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:48.724568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448063-199e-4518-be64-3287832699da admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:48.738947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71448063-199e-4518-be64-3287832699da admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:48.744238 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc167-1dcb-4e5f-857c-bfd4fbd9ddff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:48.744859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc167-1dcb-4e5f-857c-bfd4fbd9ddff admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.749560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc167-1dcb-4e5f-857c-bfd4fbd9ddff admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.749560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ccc167-1dcb-4e5f-857c-bfd4fbd9ddff admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.749560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccc167-1dcb-4e5f-857c-bfd4fbd9ddff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:48.749560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ccc167-1dcb-4e5f-857c-bfd4fbd9ddff admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:48.757423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b61aa9-3cd7-4135-aaac-6a18bd272dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:48.759189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b61aa9-3cd7-4135-aaac-6a18bd272dc7 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:48.770485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1118/2224] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:48 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:48.870103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1107/2225] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:48 2022] POST /identity/v3/projects => generated 381 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:48.874556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b61aa9-3cd7-4135-aaac-6a18bd272dc7 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:48.886640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b61aa9-3cd7-4135-aaac-6a18bd272dc7 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:48.967734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bee03-47e6-4b20-b85f-561d7d831ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:48.968607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bee03-47e6-4b20-b85f-561d7d831ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:48.968984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bee03-47e6-4b20-b85f-561d7d831ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:48.969207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bee03-47e6-4b20-b85f-561d7d831ea6 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:48.969892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bee03-47e6-4b20-b85f-561d7d831ea6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:48.972696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551bee03-47e6-4b20-b85f-561d7d831ea6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:49.059693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1119/2226] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:48 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:49.062925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc167-1dcb-4e5f-857c-bfd4fbd9ddff admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:49.073656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ccc167-1dcb-4e5f-857c-bfd4fbd9ddff admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:49.078353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c5e47-c079-43cd-8044-3103c127d662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:49.078961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c5e47-c079-43cd-8044-3103c127d662 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:49.080303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c5e47-c079-43cd-8044-3103c127d662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:49.080303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c5e47-c079-43cd-8044-3103c127d662 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:49.080303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c5e47-c079-43cd-8044-3103c127d662 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:49.081919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c5e47-c079-43cd-8044-3103c127d662 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:49.091927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1108/2227] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:49.096259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bee03-47e6-4b20-b85f-561d7d831ea6 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:49.106936 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bee03-47e6-4b20-b85f-561d7d831ea6 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:49.111637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d718fe52-781c-412f-ac00-37fab494cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:49.112797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718fe52-781c-412f-ac00-37fab494cb88 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:49.113084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718fe52-781c-412f-ac00-37fab494cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:49.113373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d718fe52-781c-412f-ac00-37fab494cb88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:49.114008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718fe52-781c-412f-ac00-37fab494cb88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:49.115703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d718fe52-781c-412f-ac00-37fab494cb88 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:49.126938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1120/2228] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:49.130289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c5e47-c079-43cd-8044-3103c127d662 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:49.140109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c5e47-c079-43cd-8044-3103c127d662 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:49.144674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7fe9c-2c87-43d5-beeb-b077959f1fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:49.145319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7fe9c-2c87-43d5-beeb-b077959f1fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:49.160922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7fe9c-2c87-43d5-beeb-b077959f1fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:49.160922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e7fe9c-2c87-43d5-beeb-b077959f1fdb admin admin] PATH_INFO: `/v3/projects/c54b33207fda4927b89602f430838b71/users/77422f4193254d7cb3f0e23a1daae5dd/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:49.162724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7fe9c-2c87-43d5-beeb-b077959f1fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c54b33207fda4927b89602f430838b71, user_id=77422f4193254d7cb3f0e23a1daae5dd, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:49.165388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e7fe9c-2c87-43d5-beeb-b077959f1fdb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:49.214809 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:49.350457 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1109/2229] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:49 2022] PUT /identity/v3/projects/c54b33207fda4927b89602f430838b71/users/77422f4193254d7cb3f0e23a1daae5dd/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:49.362280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383e3df-b371-4bfe-9bda-61ffbfe56f5e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:49.362640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383e3df-b371-4bfe-9bda-61ffbfe56f5e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:49.362996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c383e3df-b371-4bfe-9bda-61ffbfe56f5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:49.397203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c383e3df-b371-4bfe-9bda-61ffbfe56f5e None None] MFA Rules not processed for user `77422f4193254d7cb3f0e23a1daae5dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:49.398413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c383e3df-b371-4bfe-9bda-61ffbfe56f5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:49.494010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1121/2230] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:49 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:49.498411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7fe9c-2c87-43d5-beeb-b077959f1fdb admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:49.581463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e7fe9c-2c87-43d5-beeb-b077959f1fdb admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:49.586585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47264f-bf39-4192-b03b-15406f6f4296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:49.594476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47264f-bf39-4192-b03b-15406f6f4296 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:49.594476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47264f-bf39-4192-b03b-15406f6f4296 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:49.594668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd47264f-bf39-4192-b03b-15406f6f4296 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:49.595343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47264f-bf39-4192-b03b-15406f6f4296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:49.597753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd47264f-bf39-4192-b03b-15406f6f4296 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:49.767411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1110/2231] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:49 2022] POST /identity/v3/projects => generated 383 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:49.769388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383e3df-b371-4bfe-9bda-61ffbfe56f5e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:49.785671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c383e3df-b371-4bfe-9bda-61ffbfe56f5e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:49.939996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c42b7-ff82-4f56-ac6f-1b609b3261bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:49.940654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c42b7-ff82-4f56-ac6f-1b609b3261bd admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:49.940948 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c42b7-ff82-4f56-ac6f-1b609b3261bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:49.941227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68c42b7-ff82-4f56-ac6f-1b609b3261bd admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:49.941876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c42b7-ff82-4f56-ac6f-1b609b3261bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:49.943972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68c42b7-ff82-4f56-ac6f-1b609b3261bd admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:50.096349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1122/2232] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:49 2022] POST /identity/v3/users => generated 298 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:50.101184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47264f-bf39-4192-b03b-15406f6f4296 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:50.113158 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd47264f-bf39-4192-b03b-15406f6f4296 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:50.119464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ef87d-a140-45f1-b86a-393e578d24c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:50.120211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ef87d-a140-45f1-b86a-393e578d24c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:50.120584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ef87d-a140-45f1-b86a-393e578d24c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:50.120901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96ef87d-a140-45f1-b86a-393e578d24c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:50.121789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ef87d-a140-45f1-b86a-393e578d24c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:50.123444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96ef87d-a140-45f1-b86a-393e578d24c1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:50.134535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1111/2233] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:50.141770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c42b7-ff82-4f56-ac6f-1b609b3261bd admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:50.150927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68c42b7-ff82-4f56-ac6f-1b609b3261bd admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:50.156590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531c030-5e15-452f-8193-01a068325265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:50.157388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531c030-5e15-452f-8193-01a068325265 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:50.157800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531c030-5e15-452f-8193-01a068325265 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:50.158139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9531c030-5e15-452f-8193-01a068325265 admin admin] PATH_INFO: `/v3/projects/9aa0a3ad4e4742a593be7f2eb774b999/users/419d0b2464cf4a66a8245383f61835ea/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:50.180512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531c030-5e15-452f-8193-01a068325265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa0a3ad4e4742a593be7f2eb774b999, user_id=419d0b2464cf4a66a8245383f61835ea, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:50.184417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9531c030-5e15-452f-8193-01a068325265 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:50.335992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1123/2234] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:50 2022] PUT /identity/v3/projects/9aa0a3ad4e4742a593be7f2eb774b999/users/419d0b2464cf4a66a8245383f61835ea/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:50.344436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ef87d-a140-45f1-b86a-393e578d24c1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:50.361735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96ef87d-a140-45f1-b86a-393e578d24c1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:50.439653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09051527-eeaf-41a8-8f5b-3770eca64d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:50.440844 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09051527-eeaf-41a8-8f5b-3770eca64d8b admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:50.441123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09051527-eeaf-41a8-8f5b-3770eca64d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:50.441500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09051527-eeaf-41a8-8f5b-3770eca64d8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:50.442185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09051527-eeaf-41a8-8f5b-3770eca64d8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:50.443787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09051527-eeaf-41a8-8f5b-3770eca64d8b admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:50.454147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1112/2235] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:50 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:50.460395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531c030-5e15-452f-8193-01a068325265 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:50.471136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9531c030-5e15-452f-8193-01a068325265 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:50.476569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89d1f1-a50b-4081-a503-04f0fac93000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:50.477221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89d1f1-a50b-4081-a503-04f0fac93000 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:50.479729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89d1f1-a50b-4081-a503-04f0fac93000 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:50.479729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89d1f1-a50b-4081-a503-04f0fac93000 admin admin] PATH_INFO: `/v3/projects/9aa0a3ad4e4742a593be7f2eb774b999/users/419d0b2464cf4a66a8245383f61835ea/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:50.479729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89d1f1-a50b-4081-a503-04f0fac93000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa0a3ad4e4742a593be7f2eb774b999, user_id=419d0b2464cf4a66a8245383f61835ea, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:50.482563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89d1f1-a50b-4081-a503-04f0fac93000 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:50.493293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1124/2236] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:50 2022] PUT /identity/v3/projects/9aa0a3ad4e4742a593be7f2eb774b999/users/419d0b2464cf4a66a8245383f61835ea/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:50.506626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde999c5-07b3-422a-a130-b92840db5cd8 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:50.506911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde999c5-07b3-422a-a130-b92840db5cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:50.507185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde999c5-07b3-422a-a130-b92840db5cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:50.537197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bde999c5-07b3-422a-a130-b92840db5cd8 None None] MFA Rules not processed for user `419d0b2464cf4a66a8245383f61835ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:50.538692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bde999c5-07b3-422a-a130-b92840db5cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:50.641486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1113/2237] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:50.699087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89d1f1-a50b-4081-a503-04f0fac93000 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:50.700904 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bb89d1f1-a50b-4081-a503-04f0fac93000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:50.769640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89d1f1-a50b-4081-a503-04f0fac93000 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:50.773688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2556942-9bb3-4e67-8e38-003af2f93a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:50.774264 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556942-9bb3-4e67-8e38-003af2f93a8d service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:50.774606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556942-9bb3-4e67-8e38-003af2f93a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:50.774884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2556942-9bb3-4e67-8e38-003af2f93a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:50.784059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2556942-9bb3-4e67-8e38-003af2f93a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:50.785487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2556942-9bb3-4e67-8e38-003af2f93a8d service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:50.794892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1125/2238] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:51.076895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde999c5-07b3-422a-a130-b92840db5cd8 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:51.087430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde999c5-07b3-422a-a130-b92840db5cd8 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:51.091276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce7736-c98a-454a-bdcc-40dcec06177a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:51.091947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce7736-c98a-454a-bdcc-40dcec06177a service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:51.098612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce7736-c98a-454a-bdcc-40dcec06177a service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:51.098612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce7736-c98a-454a-bdcc-40dcec06177a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:51.121360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2556942-9bb3-4e67-8e38-003af2f93a8d service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:51.130415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2556942-9bb3-4e67-8e38-003af2f93a8d service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:51.134637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ec460-eba4-4e79-9339-f321a84926c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:51.135934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ec460-eba4-4e79-9339-f321a84926c6 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:51.136291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ec460-eba4-4e79-9339-f321a84926c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:51.136706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ec460-eba4-4e79-9339-f321a84926c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:51.189746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce7736-c98a-454a-bdcc-40dcec06177a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:51.191878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce7736-c98a-454a-bdcc-40dcec06177a service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:51.203401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1114/2239] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:51 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:51.215793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ec460-eba4-4e79-9339-f321a84926c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:51.217371 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ec460-eba4-4e79-9339-f321a84926c6 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:51.217936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:51.228649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1126/2240] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:51 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:51.440996 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:51.876466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce7736-c98a-454a-bdcc-40dcec06177a service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:51.961421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ec460-eba4-4e79-9339-f321a84926c6 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:51.963253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-959ec460-eba4-4e79-9339-f321a84926c6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:51.984297 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce7736-c98a-454a-bdcc-40dcec06177a service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:51.992504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ec460-eba4-4e79-9339-f321a84926c6 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:51.999254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:52.000173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.000623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.000908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] PATH_INFO: `/v3/users/06c3c6b8a87f437680efc9bd03d36b56` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:52.002131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06c3c6b8a87f437680efc9bd03d36b56)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:52.007695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:52.018631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:52.025492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.025998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.026562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] PATH_INFO: `/v3/users/77422f4193254d7cb3f0e23a1daae5dd` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:52.043062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=77422f4193254d7cb3f0e23a1daae5dd)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:52.043062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:52.304923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06c3c6b8a87f437680efc9bd03d36b56'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.313975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06c3c6b8a87f437680efc9bd03d36b56'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.316379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06c3c6b8a87f437680efc9bd03d36b56'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.317429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06c3c6b8a87f437680efc9bd03d36b56'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.322452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77422f4193254d7cb3f0e23a1daae5dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.337659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77422f4193254d7cb3f0e23a1daae5dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.338492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77422f4193254d7cb3f0e23a1daae5dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.339183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77422f4193254d7cb3f0e23a1daae5dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.456949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06c3c6b8a87f437680efc9bd03d36b56'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.477973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1127/2241] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:51 2022] DELETE /identity/v3/users/06c3c6b8a87f437680efc9bd03d36b56 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:52.479140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:52.480527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:52.554062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c1f6cdab-7696-436f-909f-1656c1cb8781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77422f4193254d7cb3f0e23a1daae5dd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.557519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785d7523-a2fb-499f-aed6-1a685d6861a9 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:52.568604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:52.568604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.568604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.568604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] PATH_INFO: `/v3/users/6e3583d081af4426aefd3ccd998f8314` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:52.568987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3583d081af4426aefd3ccd998f8314)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:52.568987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:52.589414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1115/2242] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:51 2022] DELETE /identity/v3/users/77422f4193254d7cb3f0e23a1daae5dd => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:52.591207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b53d-b15d-477d-ae65-f7d5f3239667 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.592230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b53d-b15d-477d-ae65-f7d5f3239667 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.602935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b8b53d-b15d-477d-ae65-f7d5f3239667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:52.617419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f0b8b53d-b15d-477d-ae65-f7d5f3239667 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:52.618823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f0b8b53d-b15d-477d-ae65-f7d5f3239667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:52.705323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1116/2243] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:52.709040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5486bb-e9f3-479f-973f-ec17b59fc5ad None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.709346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5486bb-e9f3-479f-973f-ec17b59fc5ad None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.709583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5486bb-e9f3-479f-973f-ec17b59fc5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:52.734009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-0d5486bb-e9f3-479f-973f-ec17b59fc5ad None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:52.735251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0d5486bb-e9f3-479f-973f-ec17b59fc5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:52.743384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1117/2244] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:52.744224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5486bb-e9f3-479f-973f-ec17b59fc5ad None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:52.745464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0d5486bb-e9f3-479f-973f-ec17b59fc5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:52.824301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5486bb-e9f3-479f-973f-ec17b59fc5ad None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:52.827612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3583d081af4426aefd3ccd998f8314'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.828845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cab18-2794-4973-85d4-2b62a61f3fc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:52.829521 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cab18-2794-4973-85d4-2b62a61f3fc2 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.829861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cab18-2794-4973-85d4-2b62a61f3fc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.830203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4cab18-2794-4973-85d4-2b62a61f3fc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:52.837353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3583d081af4426aefd3ccd998f8314'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.838442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3583d081af4426aefd3ccd998f8314'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.839800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3583d081af4426aefd3ccd998f8314'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.841551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cab18-2794-4973-85d4-2b62a61f3fc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:52.843962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4cab18-2794-4973-85d4-2b62a61f3fc2 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:52.860542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1118/2245] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:52.862101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cab18-2794-4973-85d4-2b62a61f3fc2 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:52.873910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4cab18-2794-4973-85d4-2b62a61f3fc2 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:52.879464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d6ed0-024b-4e52-90d0-5eb0cc633ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:52.880395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d6ed0-024b-4e52-90d0-5eb0cc633ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.880854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d6ed0-024b-4e52-90d0-5eb0cc633ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.881305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d6ed0-024b-4e52-90d0-5eb0cc633ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:52.884286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-650d6ed0-024b-4e52-90d0-5eb0cc633ee8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:52.900159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d6ed0-024b-4e52-90d0-5eb0cc633ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:52.902182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650d6ed0-024b-4e52-90d0-5eb0cc633ee8 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:52.922075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1119/2246] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:52.954836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3583d081af4426aefd3ccd998f8314'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:52.986063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1128/2247] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:52 2022] DELETE /identity/v3/users/6e3583d081af4426aefd3ccd998f8314 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:52.992388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2e300-0dce-48cb-8bf9-f461346542ef None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:52.992676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2e300-0dce-48cb-8bf9-f461346542ef None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:52.992978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e2e300-0dce-48cb-8bf9-f461346542ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:53.019103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f9e2e300-0dce-48cb-8bf9-f461346542ef None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:53.020931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f9e2e300-0dce-48cb-8bf9-f461346542ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:53.109505 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1120/2248] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:53.119855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:53.121706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:53.183380 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2f4383-7112-4cf9-a288-3e9fcd6664b3 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:53.188833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa67052-af72-4b2d-a538-0757a7963455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:53.189463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa67052-af72-4b2d-a538-0757a7963455 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:53.189747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa67052-af72-4b2d-a538-0757a7963455 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:53.190925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa67052-af72-4b2d-a538-0757a7963455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:53.205723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa67052-af72-4b2d-a538-0757a7963455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:53.208823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa67052-af72-4b2d-a538-0757a7963455 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:53.221849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1129/2249] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:53:53.496292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:53.802951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2e300-0dce-48cb-8bf9-f461346542ef None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:53.804544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f9e2e300-0dce-48cb-8bf9-f461346542ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:53.840850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e2e300-0dce-48cb-8bf9-f461346542ef None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:53.848718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:53.849533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:53.849878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:53.850291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] PATH_INFO: `/v3/projects/d26b37280b90491e9859c7bd4f875b4f` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:53.851699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d26b37280b90491e9859c7bd4f875b4f)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:53.853875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:53.947924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa67052-af72-4b2d-a538-0757a7963455 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:53.949447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-5fa67052-af72-4b2d-a538-0757a7963455 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:53.963187 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa67052-af72-4b2d-a538-0757a7963455 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:53.967829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:53.968710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:53.969000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:53.969514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] PATH_INFO: `/v3/projects/57aa11a6160541b59f79a4e4f70fac9b` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:53.970812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57aa11a6160541b59f79a4e4f70fac9b)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:53.973484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.082253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd26b37280b90491e9859c7bd4f875b4f', 'request_id': 'req-572baf40-be4c-49bf-8f2c-2268fee6d50e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.113920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57aa11a6160541b59f79a4e4f70fac9b', 'request_id': 'req-57388d7a-f70d-4597-adc3-a9a434404e83'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.168232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd26b37280b90491e9859c7bd4f875b4f', 'request_id': 'req-572baf40-be4c-49bf-8f2c-2268fee6d50e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.175492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd26b37280b90491e9859c7bd4f875b4f', 'request_id': 'req-572baf40-be4c-49bf-8f2c-2268fee6d50e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.186752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] The token cache is being invalidate because project d26b37280b90491e9859c7bd4f875b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:54.187048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.187747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.189441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1121/2250] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:53 2022] DELETE /identity/v3/projects/d26b37280b90491e9859c7bd4f875b4f => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:54.190964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:54.192558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:54.214713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57aa11a6160541b59f79a4e4f70fac9b', 'request_id': 'req-57388d7a-f70d-4597-adc3-a9a434404e83'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.225313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57aa11a6160541b59f79a4e4f70fac9b', 'request_id': 'req-57388d7a-f70d-4597-adc3-a9a434404e83'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.245159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] The token cache is being invalidate because project 57aa11a6160541b59f79a4e4f70fac9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:54.245468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.246136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.247685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1130/2251] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:53 2022] DELETE /identity/v3/projects/57aa11a6160541b59f79a4e4f70fac9b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:53:54.251287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:54.251287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:54.276967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572baf40-be4c-49bf-8f2c-2268fee6d50e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.318033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:54.325999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57388d7a-f70d-4597-adc3-a9a434404e83 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.332132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.332957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.333245 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.333657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] PATH_INFO: `/v3/users/5375f949e87a4bd7992ae725efabe76d` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.335075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5375f949e87a4bd7992ae725efabe76d)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.337168 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.347300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.347892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.348176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.348689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] PATH_INFO: `/v3/projects/c54b33207fda4927b89602f430838b71` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.351892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c54b33207fda4927b89602f430838b71)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.353815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:54.540784 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c54b33207fda4927b89602f430838b71', 'request_id': 'req-7664f991-119f-4895-b770-f341854e2473'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.548164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5375f949e87a4bd7992ae725efabe76d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.556225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5375f949e87a4bd7992ae725efabe76d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.557841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5375f949e87a4bd7992ae725efabe76d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.559032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5375f949e87a4bd7992ae725efabe76d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.616827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c54b33207fda4927b89602f430838b71', 'request_id': 'req-7664f991-119f-4895-b770-f341854e2473'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.629412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c54b33207fda4927b89602f430838b71', 'request_id': 'req-7664f991-119f-4895-b770-f341854e2473'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.642568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] The token cache is being invalidate because project c54b33207fda4927b89602f430838b71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:54.643398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.643741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-7664f991-119f-4895-b770-f341854e2473 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.645917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1122/2252] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:54 2022] DELETE /identity/v3/projects/c54b33207fda4927b89602f430838b71 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:54.647308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c54f6-247a-4a57-9d41-0df01f9680e7 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.647624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c54f6-247a-4a57-9d41-0df01f9680e7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.647995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c54f6-247a-4a57-9d41-0df01f9680e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.680753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7e3c54f6-247a-4a57-9d41-0df01f9680e7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:54.681989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7e3c54f6-247a-4a57-9d41-0df01f9680e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:54.751730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1123/2253] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:54.752731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c54f6-247a-4a57-9d41-0df01f9680e7 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:54.753877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f5489096-46ad-44fd-ab22-4d12889701c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5375f949e87a4bd7992ae725efabe76d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:54.760127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7e3c54f6-247a-4a57-9d41-0df01f9680e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:54.786595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c54f6-247a-4a57-9d41-0df01f9680e7 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:54.788474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1131/2254] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:54 2022] DELETE /identity/v3/users/5375f949e87a4bd7992ae725efabe76d => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:54.793051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1064c5-11a7-4aea-9d4b-01e107e6d68e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.793377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1064c5-11a7-4aea-9d4b-01e107e6d68e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.793627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1064c5-11a7-4aea-9d4b-01e107e6d68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.840870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-fa1064c5-11a7-4aea-9d4b-01e107e6d68e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:54.842283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fa1064c5-11a7-4aea-9d4b-01e107e6d68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:54.929304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:54.929999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:54.930287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:54.930637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] PATH_INFO: `/v3/users/419d0b2464cf4a66a8245383f61835ea` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:54.939264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=419d0b2464cf4a66a8245383f61835ea)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:54.947553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:55.048571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1132/2255] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:55.050646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0a7e3-a017-4b03-b42a-29ddb4fd07b2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.051081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0a7e3-a017-4b03-b42a-29ddb4fd07b2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.052923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef0a7e3-a017-4b03-b42a-29ddb4fd07b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.121140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-cef0a7e3-a017-4b03-b42a-29ddb4fd07b2 None None] MFA Rules not processed for user `2d5f07704f014ae7a4997fca3c2faa6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:55.124894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cef0a7e3-a017-4b03-b42a-29ddb4fd07b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.251760 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1133/2256] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:55.272270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0a7e3-a017-4b03-b42a-29ddb4fd07b2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.301032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '419d0b2464cf4a66a8245383f61835ea'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.334385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef0a7e3-a017-4b03-b42a-29ddb4fd07b2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:55.340105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '419d0b2464cf4a66a8245383f61835ea'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.343478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '419d0b2464cf4a66a8245383f61835ea'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.346567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '419d0b2464cf4a66a8245383f61835ea'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.347775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f27ead-2922-424c-91f8-52799135a6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:55.348570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f27ead-2922-424c-91f8-52799135a6c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.348860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f27ead-2922-424c-91f8-52799135a6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.349139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f27ead-2922-424c-91f8-52799135a6c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.349834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f27ead-2922-424c-91f8-52799135a6c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:55.350296 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f27ead-2922-424c-91f8-52799135a6c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:55.351932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f27ead-2922-424c-91f8-52799135a6c0 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:55.364662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1134/2257] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:55.366215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284edd4-81f0-4187-9151-5bb6d25f266a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.366505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284edd4-81f0-4187-9151-5bb6d25f266a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.366943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1284edd4-81f0-4187-9151-5bb6d25f266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.396466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-1284edd4-81f0-4187-9151-5bb6d25f266a None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:55.397790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1284edd4-81f0-4187-9151-5bb6d25f266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.463689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1135/2258] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:55.464730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284edd4-81f0-4187-9151-5bb6d25f266a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.466256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1284edd4-81f0-4187-9151-5bb6d25f266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.481729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1284edd4-81f0-4187-9151-5bb6d25f266a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:55.487535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854270c-0a84-449b-9a0c-026b63f55447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:55.488165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854270c-0a84-449b-9a0c-026b63f55447 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.488452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854270c-0a84-449b-9a0c-026b63f55447 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.488733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2854270c-0a84-449b-9a0c-026b63f55447 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.489379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854270c-0a84-449b-9a0c-026b63f55447 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:55.491300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2854270c-0a84-449b-9a0c-026b63f55447 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:55.528588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '419d0b2464cf4a66a8245383f61835ea'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.550039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1124/2259] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:54 2022] DELETE /identity/v3/users/419d0b2464cf4a66a8245383f61835ea => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:55.550897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.552234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.628425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1136/2260] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:55 2022] POST /identity/v3/projects => generated 375 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:55.629789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854270c-0a84-449b-9a0c-026b63f55447 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.638192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2854270c-0a84-449b-9a0c-026b63f55447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:55.663701 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f462223f-17ab-4e0e-87e6-77e90419fdc1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:55.709259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2854270c-0a84-449b-9a0c-026b63f55447 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:55.714214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:55.714858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.715135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.715410 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] PATH_INFO: `/v3/projects/5232077041a84df7ab4132aac0888ce2` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.716571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5232077041a84df7ab4132aac0888ce2)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:55.718999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:55.726325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c283ca-2435-4a69-b0f5-5775b603e09f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:55.726942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c283ca-2435-4a69-b0f5-5775b603e09f service swift] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.727234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c283ca-2435-4a69-b0f5-5775b603e09f service swift] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.727503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c283ca-2435-4a69-b0f5-5775b603e09f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.794718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c283ca-2435-4a69-b0f5-5775b603e09f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:55.796706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c283ca-2435-4a69-b0f5-5775b603e09f service swift] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:55.806352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1125/2261] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:53:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:53:55.807275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c283ca-2435-4a69-b0f5-5775b603e09f service swift] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.820528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c283ca-2435-4a69-b0f5-5775b603e09f service swift] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:55.838256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc83f13-d4f4-4cde-bcfe-b663e1b7d9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:55.838256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc83f13-d4f4-4cde-bcfe-b663e1b7d9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:55.838256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc83f13-d4f4-4cde-bcfe-b663e1b7d9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:55.838256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc83f13-d4f4-4cde-bcfe-b663e1b7d9c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:55.839247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc83f13-d4f4-4cde-bcfe-b663e1b7d9c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:55.839637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc83f13-d4f4-4cde-bcfe-b663e1b7d9c4 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:55.902147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5232077041a84df7ab4132aac0888ce2', 'request_id': 'req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:55.976168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1126/2262] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:55 2022] POST /identity/v3/users => generated 288 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:55.980549 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc83f13-d4f4-4cde-bcfe-b663e1b7d9c4 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:55.993001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc83f13-d4f4-4cde-bcfe-b663e1b7d9c4 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:56.031544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5232077041a84df7ab4132aac0888ce2', 'request_id': 'req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.038565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5232077041a84df7ab4132aac0888ce2', 'request_id': 'req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.051103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] The token cache is being invalidate because project 5232077041a84df7ab4132aac0888ce2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:56.051840 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.052797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.054496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1137/2263] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:55 2022] DELETE /identity/v3/projects/5232077041a84df7ab4132aac0888ce2 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:56.060293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:56.064887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:56.067841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ac900-01b9-4d2c-9ef5-10baca7fea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:56.068736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ac900-01b9-4d2c-9ef5-10baca7fea6e admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:56.069079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ac900-01b9-4d2c-9ef5-10baca7fea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:56.069420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ac900-01b9-4d2c-9ef5-10baca7fea6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:56.070201 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ac900-01b9-4d2c-9ef5-10baca7fea6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:56.072095 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38ac900-01b9-4d2c-9ef5-10baca7fea6e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:56.085559 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1127/2264] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:56.089441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ac900-01b9-4d2c-9ef5-10baca7fea6e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:56.097376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a38ac900-01b9-4d2c-9ef5-10baca7fea6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:56.102006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3a751a-6ee2-4b54-a16c-03d0c083dd3c admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:56.116539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:56.117749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:56.118184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:56.118780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] PATH_INFO: `/v3/users/f4a7bb1a8d264f6a8ee79315efaeb201` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:56.120194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4a7bb1a8d264f6a8ee79315efaeb201)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:56.122514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:56.133984 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ac900-01b9-4d2c-9ef5-10baca7fea6e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:56.143799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914a065-fa08-402f-a199-7b01a3f99877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:56.145327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914a065-fa08-402f-a199-7b01a3f99877 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:56.146516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914a065-fa08-402f-a199-7b01a3f99877 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:56.146879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914a065-fa08-402f-a199-7b01a3f99877 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:56.147712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914a065-fa08-402f-a199-7b01a3f99877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:56.150422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914a065-fa08-402f-a199-7b01a3f99877 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:56.163782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1128/2265] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:53:56.165122 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914a065-fa08-402f-a199-7b01a3f99877 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:56.166974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7914a065-fa08-402f-a199-7b01a3f99877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:56.183153 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914a065-fa08-402f-a199-7b01a3f99877 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:56.196441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:56.197200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:56.197479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:56.201349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] PATH_INFO: `/v3/users/29a21f4f629a4e118234b5168b9c90ec` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:56.204835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=29a21f4f629a4e118234b5168b9c90ec)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:56.208693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:56.595879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4a7bb1a8d264f6a8ee79315efaeb201'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.612783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4a7bb1a8d264f6a8ee79315efaeb201'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.614417 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4a7bb1a8d264f6a8ee79315efaeb201'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.615722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4a7bb1a8d264f6a8ee79315efaeb201'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:56.957132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4a7bb1a8d264f6a8ee79315efaeb201'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.001994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1138/2266] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:56 2022] DELETE /identity/v3/users/f4a7bb1a8d264f6a8ee79315efaeb201 => generated 0 bytes in 939 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:57.003332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.005075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.014214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29a21f4f629a4e118234b5168b9c90ec'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.038056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29a21f4f629a4e118234b5168b9c90ec'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.039351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29a21f4f629a4e118234b5168b9c90ec'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.040011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29a21f4f629a4e118234b5168b9c90ec'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.130329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b7eab-9f17-48a4-8840-7dbdf65a0942 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.144633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6a0a2-0619-4966-9988-83ff9bff2210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.145936 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6a0a2-0619-4966-9988-83ff9bff2210 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.146527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6a0a2-0619-4966-9988-83ff9bff2210 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.147006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6a0a2-0619-4966-9988-83ff9bff2210 admin admin] PATH_INFO: `/v3/projects/cc986b90d10445018458d33f2ef19545/users/1b2f459eb5bb43c8908c21a4605ce935/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.165440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29a21f4f629a4e118234b5168b9c90ec'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.166095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6a0a2-0619-4966-9988-83ff9bff2210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc986b90d10445018458d33f2ef19545, user_id=1b2f459eb5bb43c8908c21a4605ce935, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.169393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6a0a2-0619-4966-9988-83ff9bff2210 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.189384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1129/2267] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:56 2022] DELETE /identity/v3/users/29a21f4f629a4e118234b5168b9c90ec => generated 0 bytes in 1025 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:57.194369 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.196774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.281036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac367721-eb6b-4d0a-9609-acbfa9b01c6e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.289977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.290856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.291273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.291652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] PATH_INFO: `/v3/projects/9aa0a3ad4e4742a593be7f2eb774b999` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.296330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa0a3ad4e4742a593be7f2eb774b999)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.298370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.326316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1139/2268] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:57 2022] PUT /identity/v3/projects/cc986b90d10445018458d33f2ef19545/users/1b2f459eb5bb43c8908c21a4605ce935/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:57.327908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f2c6-0000-4667-88ab-d6d57dca276e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.328206 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f2c6-0000-4667-88ab-d6d57dca276e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.329010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9304f2c6-0000-4667-88ab-d6d57dca276e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.367674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:57.381190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9304f2c6-0000-4667-88ab-d6d57dca276e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:57.382561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9304f2c6-0000-4667-88ab-d6d57dca276e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.488338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa0a3ad4e4742a593be7f2eb774b999', 'request_id': 'req-16351b2a-415a-40a1-a26e-fb401158ac77'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.501994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1140/2269] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:57.504623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d3ba6-54a8-4012-b818-74a3d1dd69e3 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.505001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d3ba6-54a8-4012-b818-74a3d1dd69e3 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.505373 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d3ba6-54a8-4012-b818-74a3d1dd69e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.538029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-4c3d3ba6-54a8-4012-b818-74a3d1dd69e3 None None] MFA Rules not processed for user `1b2f459eb5bb43c8908c21a4605ce935`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:57.539270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4c3d3ba6-54a8-4012-b818-74a3d1dd69e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.579471 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:53:57.614555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa0a3ad4e4742a593be7f2eb774b999', 'request_id': 'req-16351b2a-415a-40a1-a26e-fb401158ac77'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.622405 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa0a3ad4e4742a593be7f2eb774b999', 'request_id': 'req-16351b2a-415a-40a1-a26e-fb401158ac77'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.661116 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] The token cache is being invalidate because project 9aa0a3ad4e4742a593be7f2eb774b999 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:57.662700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.665940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:57.671752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1130/2270] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:57 2022] DELETE /identity/v3/projects/9aa0a3ad4e4742a593be7f2eb774b999 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:57.672976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.678052 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.686132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1141/2271] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:57.688719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0f7b0-4bac-4b0e-b8a0-540f494c318d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.689286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0f7b0-4bac-4b0e-b8a0-540f494c318d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.689783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a0f7b0-4bac-4b0e-b8a0-540f494c318d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.716569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d8a0f7b0-4bac-4b0e-b8a0-540f494c318d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:57.718115 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d8a0f7b0-4bac-4b0e-b8a0-540f494c318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.811979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1142/2272] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:57.813180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0f7b0-4bac-4b0e-b8a0-540f494c318d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:57.814697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d8a0f7b0-4bac-4b0e-b8a0-540f494c318d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.855822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16351b2a-415a-40a1-a26e-fb401158ac77 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.866910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9f2bb7-ff6b-44a5-b4e4-a45cb23071c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.867542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2bb7-ff6b-44a5-b4e4-a45cb23071c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.868016 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2bb7-ff6b-44a5-b4e4-a45cb23071c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.868362 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9f2bb7-ff6b-44a5-b4e4-a45cb23071c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.873349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ab9f2bb7-ff6b-44a5-b4e4-a45cb23071c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.890042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f2bb7-ff6b-44a5-b4e4-a45cb23071c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:57.891875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9f2bb7-ff6b-44a5-b4e4-a45cb23071c9 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:57.925637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1131/2273] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:57.942331 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2bed4-66c7-4611-9e4e-2d7ebb52d1e3 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.942626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2bed4-66c7-4611-9e4e-2d7ebb52d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.942962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a2bed4-66c7-4611-9e4e-2d7ebb52d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.965186 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a0f7b0-4bac-4b0e-b8a0-540f494c318d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:57.976584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56567e16-6009-4599-b869-186beb977b33 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:57.977385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56567e16-6009-4599-b869-186beb977b33 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:57.977778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56567e16-6009-4599-b869-186beb977b33 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:57.978143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56567e16-6009-4599-b869-186beb977b33 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:57.980287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-56567e16-6009-4599-b869-186beb977b33 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:57.992128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f1a2bed4-66c7-4611-9e4e-2d7ebb52d1e3 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:57.993402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f1a2bed4-66c7-4611-9e4e-2d7ebb52d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.003924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56567e16-6009-4599-b869-186beb977b33 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.006681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56567e16-6009-4599-b869-186beb977b33 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.020847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1132/2274] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:58.022384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2bed4-66c7-4611-9e4e-2d7ebb52d1e3 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.023926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f1a2bed4-66c7-4611-9e4e-2d7ebb52d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.044821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a2bed4-66c7-4611-9e4e-2d7ebb52d1e3 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.046951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1143/2275] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:53:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:53:58.048193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56567e16-6009-4599-b869-186beb977b33 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.059738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.060557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.063481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.064903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] PATH_INFO: `/v3/projects/4387dd4a9b1f45e18a9528d6c8ea3249` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.070890 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4387dd4a9b1f45e18a9528d6c8ea3249)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.073304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.081648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56567e16-6009-4599-b869-186beb977b33 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.097660 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c1bf6-7928-45e2-8b33-ea6b553e2ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.100456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c1bf6-7928-45e2-8b33-ea6b553e2ca1 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.100456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c1bf6-7928-45e2-8b33-ea6b553e2ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.100456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c1bf6-7928-45e2-8b33-ea6b553e2ca1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.100456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c1bf6-7928-45e2-8b33-ea6b553e2ca1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:58.100456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c1bf6-7928-45e2-8b33-ea6b553e2ca1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.102955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c1bf6-7928-45e2-8b33-ea6b553e2ca1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.144185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1144/2276] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:58.147162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c1bf6-7928-45e2-8b33-ea6b553e2ca1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.167425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c1bf6-7928-45e2-8b33-ea6b553e2ca1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.189940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df613d2-1c71-4562-a18a-08c2f77041b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.189940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df613d2-1c71-4562-a18a-08c2f77041b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.189940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df613d2-1c71-4562-a18a-08c2f77041b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.189940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df613d2-1c71-4562-a18a-08c2f77041b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.190428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df613d2-1c71-4562-a18a-08c2f77041b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.195383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df613d2-1c71-4562-a18a-08c2f77041b7 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.326026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4387dd4a9b1f45e18a9528d6c8ea3249', 'request_id': 'req-a16f7add-588e-4ecb-977c-852cbc2b0152'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.427651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1145/2277] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:58 2022] POST /identity/v3/projects => generated 377 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:58.429377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df613d2-1c71-4562-a18a-08c2f77041b7 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.459112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4387dd4a9b1f45e18a9528d6c8ea3249', 'request_id': 'req-a16f7add-588e-4ecb-977c-852cbc2b0152'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.469940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4387dd4a9b1f45e18a9528d6c8ea3249', 'request_id': 'req-a16f7add-588e-4ecb-977c-852cbc2b0152'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.502674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] The token cache is being invalidate because project 4387dd4a9b1f45e18a9528d6c8ea3249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:58.503840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.504745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-a16f7add-588e-4ecb-977c-852cbc2b0152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:58.509613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1133/2278] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:58 2022] DELETE /identity/v3/projects/4387dd4a9b1f45e18a9528d6c8ea3249 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:58.513376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d594c-2234-4155-8620-036caa406567 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.513812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d594c-2234-4155-8620-036caa406567 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.514178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d594c-2234-4155-8620-036caa406567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.551561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-970d594c-2234-4155-8620-036caa406567 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:58.553303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-970d594c-2234-4155-8620-036caa406567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.553576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df613d2-1c71-4562-a18a-08c2f77041b7 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.562274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f76f4-3b91-47d6-b7ba-19808b11457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.562274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f76f4-3b91-47d6-b7ba-19808b11457a admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.562274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f76f4-3b91-47d6-b7ba-19808b11457a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.562274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4f76f4-3b91-47d6-b7ba-19808b11457a admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.566489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f76f4-3b91-47d6-b7ba-19808b11457a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.566489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4f76f4-3b91-47d6-b7ba-19808b11457a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.597584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1134/2279] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:58.599360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc9615-2be1-4d66-874c-0539fa823a8e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.605199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc9615-2be1-4d66-874c-0539fa823a8e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.605491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc9615-2be1-4d66-874c-0539fa823a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.637958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-befc9615-2be1-4d66-874c-0539fa823a8e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:53:58.639187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-befc9615-2be1-4d66-874c-0539fa823a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.649087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1135/2280] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:53:58.653099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc9615-2be1-4d66-874c-0539fa823a8e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.666204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc9615-2be1-4d66-874c-0539fa823a8e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.675478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9df3c-5954-48a2-9a5f-4ae08ee4092a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.675478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9df3c-5954-48a2-9a5f-4ae08ee4092a admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.675478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9df3c-5954-48a2-9a5f-4ae08ee4092a admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.675478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd9df3c-5954-48a2-9a5f-4ae08ee4092a admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.675932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9df3c-5954-48a2-9a5f-4ae08ee4092a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:53:58.675932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9df3c-5954-48a2-9a5f-4ae08ee4092a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.675932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd9df3c-5954-48a2-9a5f-4ae08ee4092a admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.702164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1136/2281] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:53:58.715249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9df3c-5954-48a2-9a5f-4ae08ee4092a admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.722312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd9df3c-5954-48a2-9a5f-4ae08ee4092a admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.728100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ff99f-a8df-4e98-a1c7-c5e0e987e3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.728796 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ff99f-a8df-4e98-a1c7-c5e0e987e3ba admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.729419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ff99f-a8df-4e98-a1c7-c5e0e987e3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.729769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0ff99f-a8df-4e98-a1c7-c5e0e987e3ba admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.730488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ff99f-a8df-4e98-a1c7-c5e0e987e3ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.733149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0ff99f-a8df-4e98-a1c7-c5e0e987e3ba admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.758035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1146/2282] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:58 2022] POST /identity/v3/users => generated 289 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:53:58.760143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f76f4-3b91-47d6-b7ba-19808b11457a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.763145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8a4f76f4-3b91-47d6-b7ba-19808b11457a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.785707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4f76f4-3b91-47d6-b7ba-19808b11457a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.797573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.798483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.798921 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.799348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] PATH_INFO: `/v3/projects/363e531dd8134c48b6a8b71f9b1127f4` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.804045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=363e531dd8134c48b6a8b71f9b1127f4)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.807166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.872970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1137/2283] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:53:58 2022] POST /identity/v3/projects => generated 371 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:58.872970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ff99f-a8df-4e98-a1c7-c5e0e987e3ba admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.874113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cf0ff99f-a8df-4e98-a1c7-c5e0e987e3ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:58.957738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0ff99f-a8df-4e98-a1c7-c5e0e987e3ba admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:58.964703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5abaa-6538-4975-9611-fc31c23125fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:58.965472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5abaa-6538-4975-9611-fc31c23125fd admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:58.965759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5abaa-6538-4975-9611-fc31c23125fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:58.966035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c5abaa-6538-4975-9611-fc31c23125fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:58.966748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5abaa-6538-4975-9611-fc31c23125fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:58.968317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c5abaa-6538-4975-9611-fc31c23125fd admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:58.984889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1138/2284] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:58.985573 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5abaa-6538-4975-9611-fc31c23125fd admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:58.997486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c5abaa-6538-4975-9611-fc31c23125fd admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:59.008778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818003-afe0-43eb-8cb4-25afd9f92a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:59.009749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818003-afe0-43eb-8cb4-25afd9f92a27 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.010191 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818003-afe0-43eb-8cb4-25afd9f92a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.010787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62818003-afe0-43eb-8cb4-25afd9f92a27 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.012015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62818003-afe0-43eb-8cb4-25afd9f92a27 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:59.014882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62818003-afe0-43eb-8cb4-25afd9f92a27 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:59.030698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '363e531dd8134c48b6a8b71f9b1127f4', 'request_id': 'req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.157666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '363e531dd8134c48b6a8b71f9b1127f4', 'request_id': 'req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.180540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1139/2285] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:53:58 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:53:59.180540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818003-afe0-43eb-8cb4-25afd9f92a27 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:59.181091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '363e531dd8134c48b6a8b71f9b1127f4', 'request_id': 'req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.214919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62818003-afe0-43eb-8cb4-25afd9f92a27 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:59.220541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] The token cache is being invalidate because project 363e531dd8134c48b6a8b71f9b1127f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:53:59.221297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.223819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.232639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1147/2286] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:53:58 2022] DELETE /identity/v3/projects/363e531dd8134c48b6a8b71f9b1127f4 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:59.235741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:59.238206 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:59.354376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf576668-bc08-4ffa-b2a7-89b2c58e7e59 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:59.365662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e654da8-9e93-45e7-a979-b31144d098d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:59.368960 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654da8-9e93-45e7-a979-b31144d098d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.371986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654da8-9e93-45e7-a979-b31144d098d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.371986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e654da8-9e93-45e7-a979-b31144d098d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.372342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e654da8-9e93-45e7-a979-b31144d098d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:59.376712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e654da8-9e93-45e7-a979-b31144d098d1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:59.379531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74778755-abb3-42e9-b13b-6d35eb45acfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:59.380710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74778755-abb3-42e9-b13b-6d35eb45acfe admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.381029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74778755-abb3-42e9-b13b-6d35eb45acfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.381312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74778755-abb3-42e9-b13b-6d35eb45acfe admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.383800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74778755-abb3-42e9-b13b-6d35eb45acfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:59.388756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74778755-abb3-42e9-b13b-6d35eb45acfe admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:59.403465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1148/2287] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:59.404346 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e654da8-9e93-45e7-a979-b31144d098d1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:59.413719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8e654da8-9e93-45e7-a979-b31144d098d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:59.419371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1140/2288] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:59.423160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74778755-abb3-42e9-b13b-6d35eb45acfe admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:59.434872 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74778755-abb3-42e9-b13b-6d35eb45acfe admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:59.443126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e654da8-9e93-45e7-a979-b31144d098d1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:59.449823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcf086-2cf4-4b2d-a3b5-5db1586ed728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:59.450473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcf086-2cf4-4b2d-a3b5-5db1586ed728 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.450756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcf086-2cf4-4b2d-a3b5-5db1586ed728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.451119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fcf086-2cf4-4b2d-a3b5-5db1586ed728 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.452765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcf086-2cf4-4b2d-a3b5-5db1586ed728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:59.455085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:59.456872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.457901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fcf086-2cf4-4b2d-a3b5-5db1586ed728 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:59.458945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.459566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] PATH_INFO: `/v3/users/b8fbebbb38f746e28a6fa0ea56a47fdd` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.461777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8fbebbb38f746e28a6fa0ea56a47fdd)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:59.481070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:59.491499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1141/2289] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:53:59 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:53:59.491967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcf086-2cf4-4b2d-a3b5-5db1586ed728 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:59.505104 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-91fcf086-2cf4-4b2d-a3b5-5db1586ed728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:53:59.532493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fcf086-2cf4-4b2d-a3b5-5db1586ed728 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:59.547789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfee51-8f2a-4aac-8f81-79ce6a240dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:59.548621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfee51-8f2a-4aac-8f81-79ce6a240dbf admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.548905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfee51-8f2a-4aac-8f81-79ce6a240dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.549448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bfee51-8f2a-4aac-8f81-79ce6a240dbf admin admin] PATH_INFO: `/v3/projects/445a1486d9e64a91a2a9e0a10cf5bf17/users/9491e81194184b51be7415cb217819af/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.578671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfee51-8f2a-4aac-8f81-79ce6a240dbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=445a1486d9e64a91a2a9e0a10cf5bf17, user_id=9491e81194184b51be7415cb217819af, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:59.582659 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bfee51-8f2a-4aac-8f81-79ce6a240dbf admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:59.745744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1142/2290] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:59 2022] PUT /identity/v3/projects/445a1486d9e64a91a2a9e0a10cf5bf17/users/9491e81194184b51be7415cb217819af/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:53:59.747470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfee51-8f2a-4aac-8f81-79ce6a240dbf admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:53:59.784589 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8fbebbb38f746e28a6fa0ea56a47fdd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.797828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8fbebbb38f746e28a6fa0ea56a47fdd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.797828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8fbebbb38f746e28a6fa0ea56a47fdd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.797828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8fbebbb38f746e28a6fa0ea56a47fdd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:53:59.887918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bfee51-8f2a-4aac-8f81-79ce6a240dbf admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:53:59.893088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585351a-4e5e-4871-b9b8-2c080a30aecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:53:59.893817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585351a-4e5e-4871-b9b8-2c080a30aecb admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:53:59.894105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585351a-4e5e-4871-b9b8-2c080a30aecb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:53:59.894405 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585351a-4e5e-4871-b9b8-2c080a30aecb admin admin] PATH_INFO: `/v3/projects/9cf92844fe1140b3a74903a3491bef3a/users/a01d3756c02c476cb051229cc6ce9bca/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:53:59.913066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585351a-4e5e-4871-b9b8-2c080a30aecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf92844fe1140b3a74903a3491bef3a, user_id=a01d3756c02c476cb051229cc6ce9bca, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:53:59.916541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585351a-4e5e-4871-b9b8-2c080a30aecb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:53:59.926437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-e8631872-e1d6-4278-9b45-03442d1a1a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8fbebbb38f746e28a6fa0ea56a47fdd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:00.001947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1149/2291] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:53:59 2022] DELETE /identity/v3/users/b8fbebbb38f746e28a6fa0ea56a47fdd => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:00.001947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e143-3971-42d9-9647-0e73f6ae748b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.001947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e143-3971-42d9-9647-0e73f6ae748b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.001947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d4e143-3971-42d9-9647-0e73f6ae748b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.001947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-17d4e143-3971-42d9-9647-0e73f6ae748b None None] MFA Rules not processed for user `9491e81194184b51be7415cb217819af`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:00.001947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-17d4e143-3971-42d9-9647-0e73f6ae748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.063360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1150/2292] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:53:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:00.068669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4e143-3971-42d9-9647-0e73f6ae748b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.070185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-17d4e143-3971-42d9-9647-0e73f6ae748b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.133429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d4e143-3971-42d9-9647-0e73f6ae748b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:00.138615 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda579cc-d12e-4917-b497-394c4caa93bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:00.139222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda579cc-d12e-4917-b497-394c4caa93bb admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.139502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda579cc-d12e-4917-b497-394c4caa93bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.139803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda579cc-d12e-4917-b497-394c4caa93bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.140435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda579cc-d12e-4917-b497-394c4caa93bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:00.142328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda579cc-d12e-4917-b497-394c4caa93bb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:00.541225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1143/2293] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:53:59 2022] PUT /identity/v3/projects/9cf92844fe1140b3a74903a3491bef3a/users/a01d3756c02c476cb051229cc6ce9bca/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:00.546317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7372a-b1b5-4b49-9a91-2616ed209f8e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.546615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7372a-b1b5-4b49-9a91-2616ed209f8e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.546876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c7372a-b1b5-4b49-9a91-2616ed209f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.566137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-15c7372a-b1b5-4b49-9a91-2616ed209f8e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:00.567335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-15c7372a-b1b5-4b49-9a91-2616ed209f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.632439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1151/2294] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:00 2022] POST /identity/v3/projects => generated 377 bytes in 564 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:00.635878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda579cc-d12e-4917-b497-394c4caa93bb admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.696723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1144/2295] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:00.712744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7372a-b1b5-4b49-9a91-2616ed209f8e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:00.716579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-15c7372a-b1b5-4b49-9a91-2616ed209f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:00.788546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda579cc-d12e-4917-b497-394c4caa93bb admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:00.799770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5da15d-a448-490b-9254-090156e80daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:00.800464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5da15d-a448-490b-9254-090156e80daf admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:00.800730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5da15d-a448-490b-9254-090156e80daf admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:00.801004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5da15d-a448-490b-9254-090156e80daf admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:00.801644 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5da15d-a448-490b-9254-090156e80daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:00.816942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5da15d-a448-490b-9254-090156e80daf admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:00.895803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c7372a-b1b5-4b49-9a91-2616ed209f8e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:00.986733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1152/2296] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:00 2022] POST /identity/v3/users => generated 289 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:54:00.992528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5da15d-a448-490b-9254-090156e80daf admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:01.008403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5da15d-a448-490b-9254-090156e80daf admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:01.016637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc17b0-135b-4ea8-a8fa-8f67d84e95b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.016997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc17b0-135b-4ea8-a8fa-8f67d84e95b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.017333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc17b0-135b-4ea8-a8fa-8f67d84e95b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.017919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc17b0-135b-4ea8-a8fa-8f67d84e95b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.018473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc17b0-135b-4ea8-a8fa-8f67d84e95b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.020627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc17b0-135b-4ea8-a8fa-8f67d84e95b2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:01.035638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1153/2297] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:00 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:01.036718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc17b0-135b-4ea8-a8fa-8f67d84e95b2 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:01.042502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426fd78-b96a-4b97-9d30-680e78fce49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.043537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426fd78-b96a-4b97-9d30-680e78fce49a service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.044119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426fd78-b96a-4b97-9d30-680e78fce49a service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.044642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426fd78-b96a-4b97-9d30-680e78fce49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.056062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc17b0-135b-4ea8-a8fa-8f67d84e95b2 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:01.062824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:01.068106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a3d66-2798-4e8f-aa0b-6b4333bdee28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.073278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a3d66-2798-4e8f-aa0b-6b4333bdee28 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.073438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426fd78-b96a-4b97-9d30-680e78fce49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.073438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5426fd78-b96a-4b97-9d30-680e78fce49a service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:01.073658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a3d66-2798-4e8f-aa0b-6b4333bdee28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.073658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a3d66-2798-4e8f-aa0b-6b4333bdee28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.073658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a3d66-2798-4e8f-aa0b-6b4333bdee28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.075684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a3d66-2798-4e8f-aa0b-6b4333bdee28 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:01.085960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1145/2298] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:01.093702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1154/2299] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:01.095658 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:01.097854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426fd78-b96a-4b97-9d30-680e78fce49a service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:01.111140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426fd78-b96a-4b97-9d30-680e78fce49a service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:01.116190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a3d66-2798-4e8f-aa0b-6b4333bdee28 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:01.117165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afb49eb-41a7-4f72-addf-53ff171b12b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.119047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb49eb-41a7-4f72-addf-53ff171b12b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.119690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb49eb-41a7-4f72-addf-53ff171b12b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.123640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb49eb-41a7-4f72-addf-53ff171b12b7 admin admin] PATH_INFO: `/v3/projects/70b878e794564e61b048440b2cd55cd4/users/83e4949d23cc4b13bbd0281722151e42/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.123952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-987a3d66-2798-4e8f-aa0b-6b4333bdee28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:01.152051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a3d66-2798-4e8f-aa0b-6b4333bdee28 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:01.161038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb49eb-41a7-4f72-addf-53ff171b12b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70b878e794564e61b048440b2cd55cd4, user_id=83e4949d23cc4b13bbd0281722151e42, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.161522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.161522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.161522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.161522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] PATH_INFO: `/v3/projects/ab3f03402c0b48e1b45b82f0eb46eaac` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.161821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab3f03402c0b48e1b45b82f0eb46eaac)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.161900 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afb49eb-41a7-4f72-addf-53ff171b12b7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:01.162193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:01.328887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1146/2300] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:01 2022] PUT /identity/v3/projects/70b878e794564e61b048440b2cd55cd4/users/83e4949d23cc4b13bbd0281722151e42/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:01.330700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe78055-c149-4c5a-84f2-b428d78b4867 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.331189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe78055-c149-4c5a-84f2-b428d78b4867 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.331467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe78055-c149-4c5a-84f2-b428d78b4867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.363109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab3f03402c0b48e1b45b82f0eb46eaac', 'request_id': 'req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:01.435640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7fe78055-c149-4c5a-84f2-b428d78b4867 None None] MFA Rules not processed for user `83e4949d23cc4b13bbd0281722151e42`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:01.441754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7fe78055-c149-4c5a-84f2-b428d78b4867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:01.454601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab3f03402c0b48e1b45b82f0eb46eaac', 'request_id': 'req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:01.465896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab3f03402c0b48e1b45b82f0eb46eaac', 'request_id': 'req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:01.514464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] The token cache is being invalidate because project ab3f03402c0b48e1b45b82f0eb46eaac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:01.515076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:01.516228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a60cdc0e-3d3d-4eb5-9381-4487263c96d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:01.524395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1155/2301] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:01 2022] DELETE /identity/v3/projects/ab3f03402c0b48e1b45b82f0eb46eaac => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:01.531418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd825525-6304-4102-9245-222056088cac None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.531999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd825525-6304-4102-9245-222056088cac None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.532479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd825525-6304-4102-9245-222056088cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.564444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1147/2302] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:01.568584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe78055-c149-4c5a-84f2-b428d78b4867 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:01.576674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7fe78055-c149-4c5a-84f2-b428d78b4867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:01.593312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-bd825525-6304-4102-9245-222056088cac None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:01.594956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bd825525-6304-4102-9245-222056088cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:01.713757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1156/2303] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:01.740583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66da4-5a76-4a0c-8fde-984a04c52933 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.740896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66da4-5a76-4a0c-8fde-984a04c52933 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.741240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e66da4-5a76-4a0c-8fde-984a04c52933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.799547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe78055-c149-4c5a-84f2-b428d78b4867 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:01.805781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d4e66da4-5a76-4a0c-8fde-984a04c52933 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:01.807291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d4e66da4-5a76-4a0c-8fde-984a04c52933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:01.830807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bab1d-9e02-4a48-9e04-bd07efc08958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.830807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bab1d-9e02-4a48-9e04-bd07efc08958 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.830807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bab1d-9e02-4a48-9e04-bd07efc08958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.830807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343bab1d-9e02-4a48-9e04-bd07efc08958 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.831394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bab1d-9e02-4a48-9e04-bd07efc08958 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.831474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1157/2304] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:01.834785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66da4-5a76-4a0c-8fde-984a04c52933 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:01.837064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343bab1d-9e02-4a48-9e04-bd07efc08958 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:01.855451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e66da4-5a76-4a0c-8fde-984a04c52933 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:01.867325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23814970-4f1f-4e3b-add9-9593d2f260e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.868369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23814970-4f1f-4e3b-add9-9593d2f260e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.868657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23814970-4f1f-4e3b-add9-9593d2f260e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.868932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23814970-4f1f-4e3b-add9-9593d2f260e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.872182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23814970-4f1f-4e3b-add9-9593d2f260e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:54:01.872534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23814970-4f1f-4e3b-add9-9593d2f260e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.876066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23814970-4f1f-4e3b-add9-9593d2f260e2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:01.891566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1158/2305] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:54:01.894464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23814970-4f1f-4e3b-add9-9593d2f260e2 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:01.921237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23814970-4f1f-4e3b-add9-9593d2f260e2 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:01.930037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8f568-839d-4677-95d5-e837e19caa2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:01.930936 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f568-839d-4677-95d5-e837e19caa2c admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:01.931325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f568-839d-4677-95d5-e837e19caa2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:01.931755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f8f568-839d-4677-95d5-e837e19caa2c admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:01.932562 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8f568-839d-4677-95d5-e837e19caa2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:01.934642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f8f568-839d-4677-95d5-e837e19caa2c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:02.004671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1148/2306] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:01 2022] POST /identity/v3/projects => generated 377 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:02.005523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bab1d-9e02-4a48-9e04-bd07efc08958 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:02.102947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1159/2307] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:01 2022] POST /identity/v3/projects => generated 399 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:02.103972 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8f568-839d-4677-95d5-e837e19caa2c admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:02.172535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343bab1d-9e02-4a48-9e04-bd07efc08958 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:02.218356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f8f568-839d-4677-95d5-e837e19caa2c admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:02.232126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864384a9-e5cf-43cd-9731-94002dbd8034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:02.247934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864384a9-e5cf-43cd-9731-94002dbd8034 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:02.247934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864384a9-e5cf-43cd-9731-94002dbd8034 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:02.247934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864384a9-e5cf-43cd-9731-94002dbd8034 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:02.247934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864384a9-e5cf-43cd-9731-94002dbd8034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:02.254530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864384a9-e5cf-43cd-9731-94002dbd8034 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:02.330540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27faab-654e-4c6d-95d3-256ee4876752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:02.331911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27faab-654e-4c6d-95d3-256ee4876752 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:02.332187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27faab-654e-4c6d-95d3-256ee4876752 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:02.332459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27faab-654e-4c6d-95d3-256ee4876752 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:02.333120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27faab-654e-4c6d-95d3-256ee4876752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:02.335053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27faab-654e-4c6d-95d3-256ee4876752 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:02.481396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1160/2308] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:02 2022] POST /identity/v3/users => generated 300 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:02.486242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864384a9-e5cf-43cd-9731-94002dbd8034 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:02.503629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864384a9-e5cf-43cd-9731-94002dbd8034 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:02.511021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1149/2309] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:02 2022] POST /identity/v3/users => generated 295 bytes in 506 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:02.512284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e4d88-c6ab-4bfa-a0d8-d8c33aee9883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:02.512909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e4d88-c6ab-4bfa-a0d8-d8c33aee9883 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:02.513195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e4d88-c6ab-4bfa-a0d8-d8c33aee9883 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:02.513472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e4d88-c6ab-4bfa-a0d8-d8c33aee9883 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:02.514197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e4d88-c6ab-4bfa-a0d8-d8c33aee9883 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:02.515266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27faab-654e-4c6d-95d3-256ee4876752 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:02.515923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e4d88-c6ab-4bfa-a0d8-d8c33aee9883 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:02.535625 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1161/2310] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:02.536638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e4d88-c6ab-4bfa-a0d8-d8c33aee9883 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:02.540907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27faab-654e-4c6d-95d3-256ee4876752 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:02.550792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e4d88-c6ab-4bfa-a0d8-d8c33aee9883 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:02.561386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3b6e3-ef22-491c-9987-c80a7f8112d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:02.562020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3b6e3-ef22-491c-9987-c80a7f8112d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:02.562297 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3b6e3-ef22-491c-9987-c80a7f8112d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:02.562577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3b6e3-ef22-491c-9987-c80a7f8112d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:02.563235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3b6e3-ef22-491c-9987-c80a7f8112d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:02.564903 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46565a6-b0d9-420e-9ef9-e531ff0210f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:02.565050 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3b6e3-ef22-491c-9987-c80a7f8112d3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:02.566104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46565a6-b0d9-420e-9ef9-e531ff0210f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:02.566336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46565a6-b0d9-420e-9ef9-e531ff0210f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:02.567395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46565a6-b0d9-420e-9ef9-e531ff0210f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:02.570031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46565a6-b0d9-420e-9ef9-e531ff0210f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:02.571103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46565a6-b0d9-420e-9ef9-e531ff0210f6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:02.607797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1150/2311] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:02.607797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3b6e3-ef22-491c-9987-c80a7f8112d3 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:02.608541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1162/2312] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:02.610222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46565a6-b0d9-420e-9ef9-e531ff0210f6 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:02.626092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46565a6-b0d9-420e-9ef9-e531ff0210f6 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:02.632768 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daf4281-561f-4670-9092-17893036e190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:02.634058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4281-561f-4670-9092-17893036e190 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:02.638635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4281-561f-4670-9092-17893036e190 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:02.638635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daf4281-561f-4670-9092-17893036e190 admin admin] PATH_INFO: `/v3/projects/12048beb91164c3b86bb14c115645d49/users/8b3ea4d6ab3d49bead9dfdb72d737fb2/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:02.640989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3b6e3-ef22-491c-9987-c80a7f8112d3 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:02.653624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf4281-561f-4670-9092-17893036e190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12048beb91164c3b86bb14c115645d49, user_id=8b3ea4d6ab3d49bead9dfdb72d737fb2, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:02.657112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3daf4281-561f-4670-9092-17893036e190 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:02.659012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc1ea-f617-4d21-883c-4fdfb2db8678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:02.660946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc1ea-f617-4d21-883c-4fdfb2db8678 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:02.661537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc1ea-f617-4d21-883c-4fdfb2db8678 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:02.661816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cdc1ea-f617-4d21-883c-4fdfb2db8678 admin admin] PATH_INFO: `/v3/projects/ab43003325ad49849dc504c245b59fc4/users/fef6e7f185ca4c69af0b9d52a55ed1b4/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:02.685179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdc1ea-f617-4d21-883c-4fdfb2db8678 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab43003325ad49849dc504c245b59fc4, user_id=fef6e7f185ca4c69af0b9d52a55ed1b4, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:02.690046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cdc1ea-f617-4d21-883c-4fdfb2db8678 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:02.882991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1163/2313] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:02 2022] PUT /identity/v3/projects/12048beb91164c3b86bb14c115645d49/users/8b3ea4d6ab3d49bead9dfdb72d737fb2/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:02.885980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd8d63-7409-46c6-99ab-293231a41b09 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:02.885980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd8d63-7409-46c6-99ab-293231a41b09 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:02.886199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd8d63-7409-46c6-99ab-293231a41b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:02.903292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1151/2314] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:02 2022] PUT /identity/v3/projects/ab43003325ad49849dc504c245b59fc4/users/fef6e7f185ca4c69af0b9d52a55ed1b4/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:02.908873 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc1ea-f617-4d21-883c-4fdfb2db8678 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:02.947977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-37dd8d63-7409-46c6-99ab-293231a41b09 None None] MFA Rules not processed for user `8b3ea4d6ab3d49bead9dfdb72d737fb2`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:02.949218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-37dd8d63-7409-46c6-99ab-293231a41b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:03.079837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1164/2315] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:03.081316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd8d63-7409-46c6-99ab-293231a41b09 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:03.119306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cdc1ea-f617-4d21-883c-4fdfb2db8678 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:03.124771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce8904-d4b8-4fab-af0e-87cd6024ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:03.125517 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce8904-d4b8-4fab-af0e-87cd6024ab3a admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:03.125915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce8904-d4b8-4fab-af0e-87cd6024ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:03.126193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce8904-d4b8-4fab-af0e-87cd6024ab3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:03.127329 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce8904-d4b8-4fab-af0e-87cd6024ab3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:03.130590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce8904-d4b8-4fab-af0e-87cd6024ab3a admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:03.149067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1152/2316] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:02 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:03.150522 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce8904-d4b8-4fab-af0e-87cd6024ab3a admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:03.164819 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce8904-d4b8-4fab-af0e-87cd6024ab3a admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:03.174680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f703ee-3042-45d4-ae19-7c58bb816fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:03.176178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f703ee-3042-45d4-ae19-7c58bb816fee admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:03.180192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f703ee-3042-45d4-ae19-7c58bb816fee admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:03.180192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f703ee-3042-45d4-ae19-7c58bb816fee admin admin] PATH_INFO: `/v3/projects/ab43003325ad49849dc504c245b59fc4/users/fef6e7f185ca4c69af0b9d52a55ed1b4/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:03.201223 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f703ee-3042-45d4-ae19-7c58bb816fee admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab43003325ad49849dc504c245b59fc4, user_id=fef6e7f185ca4c69af0b9d52a55ed1b4, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:03.203384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f703ee-3042-45d4-ae19-7c58bb816fee admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:03.231607 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1153/2317] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:03 2022] PUT /identity/v3/projects/ab43003325ad49849dc504c245b59fc4/users/fef6e7f185ca4c69af0b9d52a55ed1b4/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:03.236398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d912a-d9fc-4d73-a51c-d88efe9fcb2d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:03.236807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d912a-d9fc-4d73-a51c-d88efe9fcb2d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:03.237182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d912a-d9fc-4d73-a51c-d88efe9fcb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:03.320699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd8d63-7409-46c6-99ab-293231a41b09 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:03.380348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-158d912a-d9fc-4d73-a51c-d88efe9fcb2d None None] MFA Rules not processed for user `fef6e7f185ca4c69af0b9d52a55ed1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:03.384891 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-158d912a-d9fc-4d73-a51c-d88efe9fcb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:03.525946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4079c873-d6d3-4244-b1f3-6f6b830f14a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:03.526818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079c873-d6d3-4244-b1f3-6f6b830f14a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:03.527166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079c873-d6d3-4244-b1f3-6f6b830f14a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:03.527592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4079c873-d6d3-4244-b1f3-6f6b830f14a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:03.528481 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079c873-d6d3-4244-b1f3-6f6b830f14a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:03.533933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4079c873-d6d3-4244-b1f3-6f6b830f14a5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:03.600272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1154/2318] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:03.604714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d912a-d9fc-4d73-a51c-d88efe9fcb2d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:03.608883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-158d912a-d9fc-4d73-a51c-d88efe9fcb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:03.683998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1165/2319] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:03 2022] POST /identity/v3/projects => generated 399 bytes in 601 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:03.683998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9879244-b665-4939-9690-ea0b03d4a766 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:03.683998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9879244-b665-4939-9690-ea0b03d4a766 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:03.683998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9879244-b665-4939-9690-ea0b03d4a766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:03.710311 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d912a-d9fc-4d73-a51c-d88efe9fcb2d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:03.726424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f9879244-b665-4939-9690-ea0b03d4a766 None None] MFA Rules not processed for user `a01d3756c02c476cb051229cc6ce9bca`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:03.726424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f9879244-b665-4939-9690-ea0b03d4a766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:03.798959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:03.799703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:03.801043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:03.801398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:03.804341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:03.839867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1166/2320] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:03.841933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9879244-b665-4939-9690-ea0b03d4a766 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:03.932830 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:03.935784 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:03.958947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1155/2321] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:03.960557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:03.962227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:03.994089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79757248-44cf-4edd-802d-63df87c1bf8b service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:04.000428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d4577-b66d-4904-81f5-32290ea14fe6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:04.002034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4577-b66d-4904-81f5-32290ea14fe6 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:04.003209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4577-b66d-4904-81f5-32290ea14fe6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:04.003720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9d4577-b66d-4904-81f5-32290ea14fe6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:04.016189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d4577-b66d-4904-81f5-32290ea14fe6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:04.018089 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9d4577-b66d-4904-81f5-32290ea14fe6 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:04.047347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1156/2322] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:04.322260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9879244-b665-4939-9690-ea0b03d4a766 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:04.337630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7753de-7339-40af-915a-32315a06cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:04.338736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7753de-7339-40af-915a-32315a06cb25 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:04.339220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7753de-7339-40af-915a-32315a06cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:04.339785 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7753de-7339-40af-915a-32315a06cb25 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:04.340616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7753de-7339-40af-915a-32315a06cb25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:04.346606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7753de-7339-40af-915a-32315a06cb25 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:04.559334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1167/2323] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:03 2022] POST /identity/v3/users => generated 306 bytes in 718 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:04.575887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d4577-b66d-4904-81f5-32290ea14fe6 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:04.613697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9d4577-b66d-4904-81f5-32290ea14fe6 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:04.625776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a08e2f-f132-4767-a603-9cdef2755b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:04.626408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a08e2f-f132-4767-a603-9cdef2755b8c admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:04.626689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a08e2f-f132-4767-a603-9cdef2755b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:04.627019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a08e2f-f132-4767-a603-9cdef2755b8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:04.632013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a08e2f-f132-4767-a603-9cdef2755b8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:04.634300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a08e2f-f132-4767-a603-9cdef2755b8c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:04.660404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1157/2324] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:04.661690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7753de-7339-40af-915a-32315a06cb25 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:04.678165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7753de-7339-40af-915a-32315a06cb25 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:04.686707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:04.696070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d06714-2a9c-4d21-96d6-c7977cc45e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:04.696070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06714-2a9c-4d21-96d6-c7977cc45e50 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:04.696070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06714-2a9c-4d21-96d6-c7977cc45e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:04.696070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d06714-2a9c-4d21-96d6-c7977cc45e50 admin admin] PATH_INFO: `/v3/projects/4e4e8470e2434aa192ec85895f0fdf3d/users/7843d45970e342f3833395d768867bfb/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:04.739620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d06714-2a9c-4d21-96d6-c7977cc45e50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4e8470e2434aa192ec85895f0fdf3d, user_id=7843d45970e342f3833395d768867bfb, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:04.743542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d06714-2a9c-4d21-96d6-c7977cc45e50 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:04.809056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:04.889092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1168/2325] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:04 2022] PUT /identity/v3/projects/4e4e8470e2434aa192ec85895f0fdf3d/users/7843d45970e342f3833395d768867bfb/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:04.892783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a08e2f-f132-4767-a603-9cdef2755b8c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:04.933103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a08e2f-f132-4767-a603-9cdef2755b8c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:05.015556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5017db3-2113-4d6c-8518-b987080f49c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:05.016196 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5017db3-2113-4d6c-8518-b987080f49c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:05.016558 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5017db3-2113-4d6c-8518-b987080f49c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:05.016896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5017db3-2113-4d6c-8518-b987080f49c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:05.017620 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5017db3-2113-4d6c-8518-b987080f49c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:05.019763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5017db3-2113-4d6c-8518-b987080f49c6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:05.031880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1158/2326] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:05.036336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d06714-2a9c-4d21-96d6-c7977cc45e50 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:05.052105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d06714-2a9c-4d21-96d6-c7977cc45e50 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:05.056927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc0363-00e9-437b-8d69-12afb03c511e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:05.057593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc0363-00e9-437b-8d69-12afb03c511e admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:05.058049 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc0363-00e9-437b-8d69-12afb03c511e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:05.058398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc0363-00e9-437b-8d69-12afb03c511e admin admin] PATH_INFO: `/v3/projects/4e4e8470e2434aa192ec85895f0fdf3d/users/7843d45970e342f3833395d768867bfb/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:05.060268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc0363-00e9-437b-8d69-12afb03c511e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e4e8470e2434aa192ec85895f0fdf3d, user_id=7843d45970e342f3833395d768867bfb, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:05.062899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc0363-00e9-437b-8d69-12afb03c511e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:05.083306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1169/2327] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:05 2022] PUT /identity/v3/projects/4e4e8470e2434aa192ec85895f0fdf3d/users/7843d45970e342f3833395d768867bfb/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:54:05.097926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfb329-b82e-4121-80d5-7e3a1ff5401c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:05.097926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfb329-b82e-4121-80d5-7e3a1ff5401c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:05.097926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabfb329-b82e-4121-80d5-7e3a1ff5401c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:05.143034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc0363-00e9-437b-8d69-12afb03c511e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:05.145947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-19dc0363-00e9-437b-8d69-12afb03c511e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:05.156799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-eabfb329-b82e-4121-80d5-7e3a1ff5401c None None] MFA Rules not processed for user `7843d45970e342f3833395d768867bfb`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:05.158398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-eabfb329-b82e-4121-80d5-7e3a1ff5401c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:05.319310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1159/2328] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:05.377411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfb329-b82e-4121-80d5-7e3a1ff5401c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:05.408882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc0363-00e9-437b-8d69-12afb03c511e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:05.430331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:05.433118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:05.433118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:05.433118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] PATH_INFO: `/v3/users/1b2f459eb5bb43c8908c21a4605ce935` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:05.434757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2f459eb5bb43c8908c21a4605ce935)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:05.441771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:05.512333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabfb329-b82e-4121-80d5-7e3a1ff5401c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:05.523601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa25da29-cfcd-417e-8823-fbb52b6429d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:05.525585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25da29-cfcd-417e-8823-fbb52b6429d4 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:05.542270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25da29-cfcd-417e-8823-fbb52b6429d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:05.543840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25da29-cfcd-417e-8823-fbb52b6429d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:05.566041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25da29-cfcd-417e-8823-fbb52b6429d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:05.567670 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa25da29-cfcd-417e-8823-fbb52b6429d4 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:05.599117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1160/2329] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:05 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:05.730102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2f459eb5bb43c8908c21a4605ce935'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:05.738475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2f459eb5bb43c8908c21a4605ce935'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:05.739221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2f459eb5bb43c8908c21a4605ce935'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:05.740144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2f459eb5bb43c8908c21a4605ce935'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:05.884004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2f459eb5bb43c8908c21a4605ce935'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:05.934685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1170/2330] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:05 2022] DELETE /identity/v3/users/1b2f459eb5bb43c8908c21a4605ce935 => generated 0 bytes in 789 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:05.936445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfec417-f577-4658-a88e-2d7de8f9e15f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:05.936920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfec417-f577-4658-a88e-2d7de8f9e15f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:05.937013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfec417-f577-4658-a88e-2d7de8f9e15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:05.975488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-edfec417-f577-4658-a88e-2d7de8f9e15f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:05.992561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-edfec417-f577-4658-a88e-2d7de8f9e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:06.011132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:06.012790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:06.137078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1161/2331] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:06.144884 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbf208-e388-469d-8671-bd6203af9256 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:06.158392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71620d-7166-4f5f-8383-bcfbc20d0491 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:06.158392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71620d-7166-4f5f-8383-bcfbc20d0491 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:06.158392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71620d-7166-4f5f-8383-bcfbc20d0491 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:06.158392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71620d-7166-4f5f-8383-bcfbc20d0491 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:06.159820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3e71620d-7166-4f5f-8383-bcfbc20d0491 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:06.163922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfec417-f577-4658-a88e-2d7de8f9e15f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:06.169202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-edfec417-f577-4658-a88e-2d7de8f9e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:06.255203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71620d-7166-4f5f-8383-bcfbc20d0491 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:06.257618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e71620d-7166-4f5f-8383-bcfbc20d0491 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:06.338752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1171/2332] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:06.518548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfec417-f577-4658-a88e-2d7de8f9e15f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:06.531796 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd70f4a-0170-4f87-82e5-e3a0eae67105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:06.532422 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd70f4a-0170-4f87-82e5-e3a0eae67105 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:06.532741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd70f4a-0170-4f87-82e5-e3a0eae67105 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:06.533038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd70f4a-0170-4f87-82e5-e3a0eae67105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:06.544344 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd70f4a-0170-4f87-82e5-e3a0eae67105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:06.546283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd70f4a-0170-4f87-82e5-e3a0eae67105 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:06.579795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1162/2333] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:06.687549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3aa33-be70-4827-882e-5b2f38ed2414 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:06.687549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3aa33-be70-4827-882e-5b2f38ed2414 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:06.688416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3aa33-be70-4827-882e-5b2f38ed2414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:06.707770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b7f3aa33-be70-4827-882e-5b2f38ed2414 None None] MFA Rules not processed for user `a01d3756c02c476cb051229cc6ce9bca`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:06.708986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b7f3aa33-be70-4827-882e-5b2f38ed2414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:06.776216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1172/2334] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:07.538396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd70f4a-0170-4f87-82e5-e3a0eae67105 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:07.539428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-edd70f4a-0170-4f87-82e5-e3a0eae67105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:07.567183 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd70f4a-0170-4f87-82e5-e3a0eae67105 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:07.615602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:07.616256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.616536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.616994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] PATH_INFO: `/v3/projects/cc986b90d10445018458d33f2ef19545` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:07.618542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc986b90d10445018458d33f2ef19545)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:07.625122 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:07.790509 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc986b90d10445018458d33f2ef19545', 'request_id': 'req-987c859a-a236-4058-a20f-37e58c14e529'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.900188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc986b90d10445018458d33f2ef19545', 'request_id': 'req-987c859a-a236-4058-a20f-37e58c14e529'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.924207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc986b90d10445018458d33f2ef19545', 'request_id': 'req-987c859a-a236-4058-a20f-37e58c14e529'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.966362 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] The token cache is being invalidate because project cc986b90d10445018458d33f2ef19545 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:07.967443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.968480 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:07.972195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1163/2335] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:07 2022] DELETE /identity/v3/projects/cc986b90d10445018458d33f2ef19545 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:07.976566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc3f3-b7b2-47bc-ac63-181a03df6d44 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:07.980112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc3f3-b7b2-47bc-ac63-181a03df6d44 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:07.980112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3dc3f3-b7b2-47bc-ac63-181a03df6d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.004360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-2c3dc3f3-b7b2-47bc-ac63-181a03df6d44 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:08.007007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2c3dc3f3-b7b2-47bc-ac63-181a03df6d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.059476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:08.095958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:08.104833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.106685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.127854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1173/2336] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:08.130022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cced9f-0d9d-4bfb-b32d-37009e45d949 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.130486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cced9f-0d9d-4bfb-b32d-37009e45d949 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.130913 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cced9f-0d9d-4bfb-b32d-37009e45d949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.151024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-25cced9f-0d9d-4bfb-b32d-37009e45d949 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:08.152289 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-25cced9f-0d9d-4bfb-b32d-37009e45d949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.161551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1174/2337] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:08.166000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cced9f-0d9d-4bfb-b32d-37009e45d949 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.176867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cced9f-0d9d-4bfb-b32d-37009e45d949 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.183715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c859a-a236-4058-a20f-37e58c14e529 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.188142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3ff87-9c91-414c-9571-dba6a03f89fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.188286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613457f-ba58-4e48-83cf-c19a867b00e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.188428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3ff87-9c91-414c-9571-dba6a03f89fa admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.188428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3ff87-9c91-414c-9571-dba6a03f89fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.188656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613457f-ba58-4e48-83cf-c19a867b00e4 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.188761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e3ff87-9c91-414c-9571-dba6a03f89fa admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.188858 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613457f-ba58-4e48-83cf-c19a867b00e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.188956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3ff87-9c91-414c-9571-dba6a03f89fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:54:08.189085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2613457f-ba58-4e48-83cf-c19a867b00e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.189235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3ff87-9c91-414c-9571-dba6a03f89fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.191799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2613457f-ba58-4e48-83cf-c19a867b00e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:08.192180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e3ff87-9c91-414c-9571-dba6a03f89fa admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.206493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1175/2338] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:54:08.210645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3ff87-9c91-414c-9571-dba6a03f89fa admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.229394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e3ff87-9c91-414c-9571-dba6a03f89fa admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.250778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c166e85-8020-410a-b33c-9a4d8d8c9325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.250778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c166e85-8020-410a-b33c-9a4d8d8c9325 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.251457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c166e85-8020-410a-b33c-9a4d8d8c9325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.254945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c166e85-8020-410a-b33c-9a4d8d8c9325 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.256255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c166e85-8020-410a-b33c-9a4d8d8c9325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.259976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c166e85-8020-410a-b33c-9a4d8d8c9325 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.374066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1176/2339] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:08 2022] POST /identity/v3/projects => generated 363 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:08.375911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c166e85-8020-410a-b33c-9a4d8d8c9325 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.380838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613457f-ba58-4e48-83cf-c19a867b00e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.384174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2613457f-ba58-4e48-83cf-c19a867b00e4 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.406299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1164/2340] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:08.504173 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c166e85-8020-410a-b33c-9a4d8d8c9325 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.522939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06d686-185b-4281-b260-1c54c0e66d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.523822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06d686-185b-4281-b260-1c54c0e66d62 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.526552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06d686-185b-4281-b260-1c54c0e66d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.527718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06d686-185b-4281-b260-1c54c0e66d62 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.528667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06d686-185b-4281-b260-1c54c0e66d62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.532760 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06d686-185b-4281-b260-1c54c0e66d62 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.685228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1177/2341] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:08 2022] POST /identity/v3/users => generated 282 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:08.686978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613457f-ba58-4e48-83cf-c19a867b00e4 service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.704019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2613457f-ba58-4e48-83cf-c19a867b00e4 service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.711820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069961c-811d-46e9-8354-0b5782962331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.712653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069961c-811d-46e9-8354-0b5782962331 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.718689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069961c-811d-46e9-8354-0b5782962331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.718689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2069961c-811d-46e9-8354-0b5782962331 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.718689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069961c-811d-46e9-8354-0b5782962331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.718689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2069961c-811d-46e9-8354-0b5782962331 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.728298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1165/2342] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:08.735941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06d686-185b-4281-b260-1c54c0e66d62 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.749977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06d686-185b-4281-b260-1c54c0e66d62 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.759163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e019d4-b8c8-42dc-9175-f891b4edd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.759163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e019d4-b8c8-42dc-9175-f891b4edd0cd admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.759163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e019d4-b8c8-42dc-9175-f891b4edd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.759163 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e019d4-b8c8-42dc-9175-f891b4edd0cd admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.759685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e019d4-b8c8-42dc-9175-f891b4edd0cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.760040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e019d4-b8c8-42dc-9175-f891b4edd0cd admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.773217 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1178/2343] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:08.778651 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069961c-811d-46e9-8354-0b5782962331 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:08.793932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2069961c-811d-46e9-8354-0b5782962331 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:08.801935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5219692-9108-4993-a4dc-28520bc2d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:08.802750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5219692-9108-4993-a4dc-28520bc2d28c admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:08.803107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5219692-9108-4993-a4dc-28520bc2d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:08.803729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5219692-9108-4993-a4dc-28520bc2d28c admin admin] PATH_INFO: `/v3/projects/f9335db7e5d74546b1d5e69dd692cd31/users/86edd5f48b4445d0a467d6493d46ff6b/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:08.830252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5219692-9108-4993-a4dc-28520bc2d28c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9335db7e5d74546b1d5e69dd692cd31, user_id=86edd5f48b4445d0a467d6493d46ff6b, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:08.836047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5219692-9108-4993-a4dc-28520bc2d28c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:08.991351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1166/2344] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:08 2022] PUT /identity/v3/projects/f9335db7e5d74546b1d5e69dd692cd31/users/86edd5f48b4445d0a467d6493d46ff6b/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:09.002445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37027-57c5-413f-aa04-c60212b5a527 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:09.003038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37027-57c5-413f-aa04-c60212b5a527 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:09.003038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc37027-57c5-413f-aa04-c60212b5a527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:09.067701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-bbc37027-57c5-413f-aa04-c60212b5a527 None None] MFA Rules not processed for user `86edd5f48b4445d0a467d6493d46ff6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:09.068959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bbc37027-57c5-413f-aa04-c60212b5a527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:09.180474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1179/2345] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:10.061235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5219692-9108-4993-a4dc-28520bc2d28c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:10.061235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b5219692-9108-4993-a4dc-28520bc2d28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:10.146530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5219692-9108-4993-a4dc-28520bc2d28c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:10.150875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704fc52f-cf21-4e5b-a0dd-cfb6c4efd291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:10.151915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc52f-cf21-4e5b-a0dd-cfb6c4efd291 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:10.152394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc52f-cf21-4e5b-a0dd-cfb6c4efd291 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:10.152964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704fc52f-cf21-4e5b-a0dd-cfb6c4efd291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:10.166557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fc52f-cf21-4e5b-a0dd-cfb6c4efd291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:10.168228 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704fc52f-cf21-4e5b-a0dd-cfb6c4efd291 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:10.179029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1167/2346] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:10.249837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:10.341651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:12.429507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:12.507633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc37027-57c5-413f-aa04-c60212b5a527 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:12.520120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc37027-57c5-413f-aa04-c60212b5a527 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:12.524184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:12.524795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:12.525081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:12.525360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:12.527434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:12.573470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:12.663837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:12.665586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:12.698255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1180/2347] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:13.819289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf4448-49f3-4906-ad39-501aac8331c0 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:13.819880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf4448-49f3-4906-ad39-501aac8331c0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:13.819880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cf4448-49f3-4906-ad39-501aac8331c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:13.841609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-79cf4448-49f3-4906-ad39-501aac8331c0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:13.842838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-79cf4448-49f3-4906-ad39-501aac8331c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:13.906298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1168/2348] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:13.923003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:13.924652 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:14.061679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202d3bc-1684-41f8-95e8-0cd6ac4cc76f service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:14.069608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0b3a7b-a8c8-4fb8-9641-c60f570a9ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:14.070070 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b3a7b-a8c8-4fb8-9641-c60f570a9ab6 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:14.070390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b3a7b-a8c8-4fb8-9641-c60f570a9ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:14.070687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0b3a7b-a8c8-4fb8-9641-c60f570a9ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:14.084573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b3a7b-a8c8-4fb8-9641-c60f570a9ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:14.090586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0b3a7b-a8c8-4fb8-9641-c60f570a9ab6 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:14.122744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1181/2349] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:14.335852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf4448-49f3-4906-ad39-501aac8331c0 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:14.337412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-79cf4448-49f3-4906-ad39-501aac8331c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:14.358042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cf4448-49f3-4906-ad39-501aac8331c0 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:14.367972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:14.368633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:14.368915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:14.369194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] PATH_INFO: `/v3/users/8b3ea4d6ab3d49bead9dfdb72d737fb2` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:14.372668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b3ea4d6ab3d49bead9dfdb72d737fb2)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:14.374685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:14.651885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b3ea4d6ab3d49bead9dfdb72d737fb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:14.660037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b3ea4d6ab3d49bead9dfdb72d737fb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:14.660825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b3ea4d6ab3d49bead9dfdb72d737fb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:14.661504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b3ea4d6ab3d49bead9dfdb72d737fb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:14.815095 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b3ea4d6ab3d49bead9dfdb72d737fb2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:14.834206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1169/2350] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:14 2022] DELETE /identity/v3/users/8b3ea4d6ab3d49bead9dfdb72d737fb2 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:14.838822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dd00b-caaa-49db-bd1d-88c31324c7ce None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:14.839107 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dd00b-caaa-49db-bd1d-88c31324c7ce None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:14.839381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dd00b-caaa-49db-bd1d-88c31324c7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:14.858731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-a49dd00b-caaa-49db-bd1d-88c31324c7ce None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:14.859980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a49dd00b-caaa-49db-bd1d-88c31324c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:14.930144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1182/2351] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:14.939855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:14.941726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:15.019475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c008babd-351b-4613-9687-eabc03aaf398 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:15.024622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccc15a-645a-4932-835a-c4573ace399f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:15.025479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccc15a-645a-4932-835a-c4573ace399f service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:15.025973 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccc15a-645a-4932-835a-c4573ace399f service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:15.026236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ccc15a-645a-4932-835a-c4573ace399f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:15.041824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccc15a-645a-4932-835a-c4573ace399f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:15.043333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ccc15a-645a-4932-835a-c4573ace399f service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:15.066581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1170/2352] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:15.650804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:15.701413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dd00b-caaa-49db-bd1d-88c31324c7ce None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:15.703484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a49dd00b-caaa-49db-bd1d-88c31324c7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:15.716160 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dd00b-caaa-49db-bd1d-88c31324c7ce None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:15.723986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:15.731541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:15.732396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:15.733750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] PATH_INFO: `/v3/projects/12048beb91164c3b86bb14c115645d49` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:15.735503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12048beb91164c3b86bb14c115645d49)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:15.739625 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:15.885752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12048beb91164c3b86bb14c115645d49', 'request_id': 'req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:15.989711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12048beb91164c3b86bb14c115645d49', 'request_id': 'req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:15.996631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12048beb91164c3b86bb14c115645d49', 'request_id': 'req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:16.007796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] The token cache is being invalidate because project 12048beb91164c3b86bb14c115645d49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:16.008091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:16.008748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:16.010224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1183/2353] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:15 2022] DELETE /identity/v3/projects/12048beb91164c3b86bb14c115645d49 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:16.014218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccc15a-645a-4932-835a-c4573ace399f service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:16.023952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ccc15a-645a-4932-835a-c4573ace399f service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:16.079732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:16.080300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:16.080611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:16.080889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] PATH_INFO: `/v3/users/7843d45970e342f3833395d768867bfb` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:16.082039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7843d45970e342f3833395d768867bfb)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:16.084076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:16.314889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7843d45970e342f3833395d768867bfb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:16.328072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7843d45970e342f3833395d768867bfb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:16.328072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7843d45970e342f3833395d768867bfb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:16.328072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7843d45970e342f3833395d768867bfb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:16.461986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ab7af050-0cc5-46aa-9ad5-21fecbf53f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7843d45970e342f3833395d768867bfb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:16.483598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1171/2354] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:16 2022] DELETE /identity/v3/users/7843d45970e342f3833395d768867bfb => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:17.000030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:17.001628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:17.016478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5d742-b8e4-4e37-b1fe-b7af93f26337 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:17.075797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:17.076749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:17.076749 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:17.076962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] PATH_INFO: `/v3/projects/4e4e8470e2434aa192ec85895f0fdf3d` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:17.078263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e4e8470e2434aa192ec85895f0fdf3d)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:17.080238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:17.252783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e4e8470e2434aa192ec85895f0fdf3d', 'request_id': 'req-d2cf638d-23c5-418e-bf4a-0584d8442dc0'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:17.272669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:17.385613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:17.386241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e4e8470e2434aa192ec85895f0fdf3d', 'request_id': 'req-d2cf638d-23c5-418e-bf4a-0584d8442dc0'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:17.393742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e4e8470e2434aa192ec85895f0fdf3d', 'request_id': 'req-d2cf638d-23c5-418e-bf4a-0584d8442dc0'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:17.405364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] The token cache is being invalidate because project 4e4e8470e2434aa192ec85895f0fdf3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:17.405765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:17.407926 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:17.410223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1184/2355] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:16 2022] DELETE /identity/v3/projects/4e4e8470e2434aa192ec85895f0fdf3d => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:19.622027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c97c3-9af4-4b46-8611-53a2e105aeb2 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:19.622523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c97c3-9af4-4b46-8611-53a2e105aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:19.622623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c97c3-9af4-4b46-8611-53a2e105aeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:19.642745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-2a5c97c3-9af4-4b46-8611-53a2e105aeb2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:19.643979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2a5c97c3-9af4-4b46-8611-53a2e105aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:19.686832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:19.688253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:19.705015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1172/2356] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:19.720544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c97c3-9af4-4b46-8611-53a2e105aeb2 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:19.723193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2a5c97c3-9af4-4b46-8611-53a2e105aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:19.758372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf638d-23c5-418e-bf4a-0584d8442dc0 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:19.763221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:19.763877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:19.764355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:19.764862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] PATH_INFO: `/v3/users/9491e81194184b51be7415cb217819af` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:19.766239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9491e81194184b51be7415cb217819af)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:19.768324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:19.819308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c97c3-9af4-4b46-8611-53a2e105aeb2 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:19.826697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9106658c-8568-420c-b841-5151153ac26f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:19.827319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106658c-8568-420c-b841-5151153ac26f service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:19.827690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106658c-8568-420c-b841-5151153ac26f service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:19.827961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9106658c-8568-420c-b841-5151153ac26f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:19.837541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106658c-8568-420c-b841-5151153ac26f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:19.839051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9106658c-8568-420c-b841-5151153ac26f service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:19.849275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1173/2357] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:20.146426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9491e81194184b51be7415cb217819af'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:20.153109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9491e81194184b51be7415cb217819af'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:20.153806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9491e81194184b51be7415cb217819af'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:20.154527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9491e81194184b51be7415cb217819af'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:20.258042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9491e81194184b51be7415cb217819af'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:20.276083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1185/2358] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:19 2022] DELETE /identity/v3/users/9491e81194184b51be7415cb217819af => generated 0 bytes in 590 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:20.280715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7e3d1-d5a5-469d-afc6-f4a39cd584d9 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:20.281003 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7e3d1-d5a5-469d-afc6-f4a39cd584d9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:20.281280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e7e3d1-d5a5-469d-afc6-f4a39cd584d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:20.300053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-d5e7e3d1-d5a5-469d-afc6-f4a39cd584d9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:20.302123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d5e7e3d1-d5a5-469d-afc6-f4a39cd584d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:20.374856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1174/2359] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:20.385008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:20.386857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:20.455393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440056e-1a16-4b50-8273-688e7e32b2e5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:20.462717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98658ee3-edb0-4fb6-be9d-0c0c56d30cc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:20.463466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98658ee3-edb0-4fb6-be9d-0c0c56d30cc7 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:20.468787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98658ee3-edb0-4fb6-be9d-0c0c56d30cc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:20.468787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98658ee3-edb0-4fb6-be9d-0c0c56d30cc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:20.475622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98658ee3-edb0-4fb6-be9d-0c0c56d30cc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:20.477239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98658ee3-edb0-4fb6-be9d-0c0c56d30cc7 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:20.499138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1186/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:21.222585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7e3d1-d5a5-469d-afc6-f4a39cd584d9 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:21.224117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d5e7e3d1-d5a5-469d-afc6-f4a39cd584d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:21.251036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e7e3d1-d5a5-469d-afc6-f4a39cd584d9 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:21.259063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:21.260650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:21.261123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:21.261539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] PATH_INFO: `/v3/projects/445a1486d9e64a91a2a9e0a10cf5bf17` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:21.263347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=445a1486d9e64a91a2a9e0a10cf5bf17)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:21.265729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:21.407043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '445a1486d9e64a91a2a9e0a10cf5bf17', 'request_id': 'req-1329381e-a961-40b3-8fb8-3ee19e51b4a1'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.489572 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '445a1486d9e64a91a2a9e0a10cf5bf17', 'request_id': 'req-1329381e-a961-40b3-8fb8-3ee19e51b4a1'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.497397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '445a1486d9e64a91a2a9e0a10cf5bf17', 'request_id': 'req-1329381e-a961-40b3-8fb8-3ee19e51b4a1'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.508421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] The token cache is being invalidate because project 445a1486d9e64a91a2a9e0a10cf5bf17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:21.508716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.509383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.510882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1175/2361] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:21 2022] DELETE /identity/v3/projects/445a1486d9e64a91a2a9e0a10cf5bf17 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:21.514883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98658ee3-edb0-4fb6-be9d-0c0c56d30cc7 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:21.525236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98658ee3-edb0-4fb6-be9d-0c0c56d30cc7 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:21.598428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:21.599618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:21.600050 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:21.607704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] PATH_INFO: `/v3/users/83e4949d23cc4b13bbd0281722151e42` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:21.607704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83e4949d23cc4b13bbd0281722151e42)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:21.607704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:21.836106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83e4949d23cc4b13bbd0281722151e42'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.844105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83e4949d23cc4b13bbd0281722151e42'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.845078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83e4949d23cc4b13bbd0281722151e42'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.845950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83e4949d23cc4b13bbd0281722151e42'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.946910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83e4949d23cc4b13bbd0281722151e42'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:21.948270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:21.981462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1187/2362] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:21 2022] DELETE /identity/v3/users/83e4949d23cc4b13bbd0281722151e42 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:22.059057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:22.504220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:22.506362 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:22.521074 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1329381e-a961-40b3-8fb8-3ee19e51b4a1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:22.584570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:22.585440 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:22.585756 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:22.585982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] PATH_INFO: `/v3/projects/70b878e794564e61b048440b2cd55cd4` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:22.587117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70b878e794564e61b048440b2cd55cd4)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:22.589470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:22.734252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70b878e794564e61b048440b2cd55cd4', 'request_id': 'req-000fa2b7-cbfa-4cee-8c31-b069aea729e2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:22.828286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70b878e794564e61b048440b2cd55cd4', 'request_id': 'req-000fa2b7-cbfa-4cee-8c31-b069aea729e2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:22.838027 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70b878e794564e61b048440b2cd55cd4', 'request_id': 'req-000fa2b7-cbfa-4cee-8c31-b069aea729e2'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:22.854300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] The token cache is being invalidate because project 70b878e794564e61b048440b2cd55cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:22.855058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:22.855933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-000fa2b7-cbfa-4cee-8c31-b069aea729e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:22.858165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1176/2363] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:22 2022] DELETE /identity/v3/projects/70b878e794564e61b048440b2cd55cd4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:22.861865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:22.864501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:22.879004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafe943-7daf-4c74-8f61-b633b150bd15 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:22.968385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:22.969112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:22.973847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:22.973847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] PATH_INFO: `/v3/users/fef6e7f185ca4c69af0b9d52a55ed1b4` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:22.973847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef6e7f185ca4c69af0b9d52a55ed1b4)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:22.973847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:23.265939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef6e7f185ca4c69af0b9d52a55ed1b4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:23.283270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef6e7f185ca4c69af0b9d52a55ed1b4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:23.284882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef6e7f185ca4c69af0b9d52a55ed1b4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:23.286798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef6e7f185ca4c69af0b9d52a55ed1b4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:23.411366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef6e7f185ca4c69af0b9d52a55ed1b4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:23.420878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710432-3e7a-4838-879a-b193561f71a5 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:23.421227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710432-3e7a-4838-879a-b193561f71a5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:23.421751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97710432-3e7a-4838-879a-b193561f71a5 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:23.423641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1177/2364] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:54:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:23.440122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1188/2365] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:22 2022] DELETE /identity/v3/users/fef6e7f185ca4c69af0b9d52a55ed1b4 => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:23.441562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf23f75-721d-45dc-8467-c144ed1c726e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:23.441852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf23f75-721d-45dc-8467-c144ed1c726e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:23.442120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf23f75-721d-45dc-8467-c144ed1c726e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:23.483080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bdf23f75-721d-45dc-8467-c144ed1c726e None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:23.484599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bdf23f75-721d-45dc-8467-c144ed1c726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:23.564785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1178/2366] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:54:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:23.578787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:23.580441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:23.659774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d636fe9-822c-43bd-9072-16dd56527ac1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:23.664445 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5662e9e9-2c36-4546-affd-8adc37a9b461 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:23.665263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662e9e9-2c36-4546-affd-8adc37a9b461 service glance] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:23.666304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662e9e9-2c36-4546-affd-8adc37a9b461 service glance] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:23.666943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5662e9e9-2c36-4546-affd-8adc37a9b461 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:23.681243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662e9e9-2c36-4546-affd-8adc37a9b461 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:23.683434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5662e9e9-2c36-4546-affd-8adc37a9b461 service glance] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:23.696593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1189/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:23.982737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf23f75-721d-45dc-8467-c144ed1c726e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:23.984220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bdf23f75-721d-45dc-8467-c144ed1c726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:24.051568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf23f75-721d-45dc-8467-c144ed1c726e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:24.056132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:24.056758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.057042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.057314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] PATH_INFO: `/v3/projects/ab43003325ad49849dc504c245b59fc4` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.058430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab43003325ad49849dc504c245b59fc4)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:24.060446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:24.092487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5fa3a-dccc-4264-9aee-36a0183660ca None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.093022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5fa3a-dccc-4264-9aee-36a0183660ca None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.093119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f5fa3a-dccc-4264-9aee-36a0183660ca None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.094361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1190/2368] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:54:24.099352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cc301-4a5d-4c2b-a2c6-f708e8736697 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.099742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cc301-4a5d-4c2b-a2c6-f708e8736697 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.100064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166cc301-4a5d-4c2b-a2c6-f708e8736697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.119682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-166cc301-4a5d-4c2b-a2c6-f708e8736697 None None] MFA Rules not processed for user `a269743c34bc48edaab5c0e3e78074c5`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:24.120874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-166cc301-4a5d-4c2b-a2c6-f708e8736697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:24.169214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1191/2369] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:24.181292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cc301-4a5d-4c2b-a2c6-f708e8736697 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:24.182678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-166cc301-4a5d-4c2b-a2c6-f708e8736697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:24.193211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166cc301-4a5d-4c2b-a2c6-f708e8736697 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:24.196949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9392225-32b0-4b23-9bcc-3b67a9628e02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:24.197358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9392225-32b0-4b23-9bcc-3b67a9628e02 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.197821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9392225-32b0-4b23-9bcc-3b67a9628e02 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.197962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9392225-32b0-4b23-9bcc-3b67a9628e02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.205441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9392225-32b0-4b23-9bcc-3b67a9628e02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:24.206956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9392225-32b0-4b23-9bcc-3b67a9628e02 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:24.215063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1192/2370] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:24.305330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960f583-1766-4f4e-a958-1b59ae2c8d46 None None] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.305620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960f583-1766-4f4e-a958-1b59ae2c8d46 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.305919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b960f583-1766-4f4e-a958-1b59ae2c8d46 None None] PATH_INFO: `/` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.307241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1193/2371] 10.222.0.25 () {54 vars in 921 bytes} [Tue Oct 4 08:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 04 08:54:24.312652 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c95884-52b7-443c-93f3-ffb932770efb None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.313016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c95884-52b7-443c-93f3-ffb932770efb None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.313447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c95884-52b7-443c-93f3-ffb932770efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.338770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-55c95884-52b7-443c-93f3-ffb932770efb None None] MFA Rules not processed for user `e05901861bc34c2398ec600150296657`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:24.340288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-55c95884-52b7-443c-93f3-ffb932770efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:24.350491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1194/2372] 10.222.0.25 () {58 vars in 1018 bytes} [Tue Oct 4 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:24.360679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c95884-52b7-443c-93f3-ffb932770efb None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:24.371582 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c95884-52b7-443c-93f3-ffb932770efb None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:24.386071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab43003325ad49849dc504c245b59fc4', 'request_id': 'req-f7cf763a-1926-4641-90b0-3795a9369f9d'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:24.428678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6577ecfa-569b-45b8-9031-2afaba273bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:24.428678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577ecfa-569b-45b8-9031-2afaba273bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.428678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577ecfa-569b-45b8-9031-2afaba273bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.428678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6577ecfa-569b-45b8-9031-2afaba273bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.488564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577ecfa-569b-45b8-9031-2afaba273bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:24.490507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6577ecfa-569b-45b8-9031-2afaba273bf2 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:24.501408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1195/2373] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:24.575760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab43003325ad49849dc504c245b59fc4', 'request_id': 'req-f7cf763a-1926-4641-90b0-3795a9369f9d'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:24.582544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab43003325ad49849dc504c245b59fc4', 'request_id': 'req-f7cf763a-1926-4641-90b0-3795a9369f9d'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:24.602469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] The token cache is being invalidate because project ab43003325ad49849dc504c245b59fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:54:24.602819 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:24.603624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f7cf763a-1926-4641-90b0-3795a9369f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:24.605337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1179/2374] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:23 2022] DELETE /identity/v3/projects/ab43003325ad49849dc504c245b59fc4 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:24.610134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae89bb9-f867-4b00-9135-2df797cde45a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.610425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae89bb9-f867-4b00-9135-2df797cde45a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.610703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae89bb9-f867-4b00-9135-2df797cde45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.631463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9ae89bb9-f867-4b00-9135-2df797cde45a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:24.632165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9ae89bb9-f867-4b00-9135-2df797cde45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:24.748082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1196/2375] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:24.805131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f8b0c-6174-4437-8ba9-08a496ebf2c7 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.805448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f8b0c-6174-4437-8ba9-08a496ebf2c7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.805681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845f8b0c-6174-4437-8ba9-08a496ebf2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.826048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-845f8b0c-6174-4437-8ba9-08a496ebf2c7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:24.827071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-845f8b0c-6174-4437-8ba9-08a496ebf2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:24.835179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1180/2376] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:24.844486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae89bb9-f867-4b00-9135-2df797cde45a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:24.854961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae89bb9-f867-4b00-9135-2df797cde45a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:24.860439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2763f2-3f1e-4bea-85d9-ccb76052e824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:24.861053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2763f2-3f1e-4bea-85d9-ccb76052e824 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.861339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2763f2-3f1e-4bea-85d9-ccb76052e824 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.861613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2763f2-3f1e-4bea-85d9-ccb76052e824 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.862284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2763f2-3f1e-4bea-85d9-ccb76052e824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:54:24.862588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2763f2-3f1e-4bea-85d9-ccb76052e824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:24.864806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2763f2-3f1e-4bea-85d9-ccb76052e824 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:24.880772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1197/2377] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:54:24.881400 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f8b0c-6174-4437-8ba9-08a496ebf2c7 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:24.898377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845f8b0c-6174-4437-8ba9-08a496ebf2c7 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:24.912845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c99cc-d0b7-4831-a642-4919a545e0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:24.916532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c99cc-d0b7-4831-a642-4919a545e0ec admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:24.916532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c99cc-d0b7-4831-a642-4919a545e0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:24.916532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c99cc-d0b7-4831-a642-4919a545e0ec admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:24.916532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c99cc-d0b7-4831-a642-4919a545e0ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:24.917005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c99cc-d0b7-4831-a642-4919a545e0ec admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:25.127943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1181/2378] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:54:24 2022] POST /identity/v3/projects => generated 367 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:54:25.129460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2763f2-3f1e-4bea-85d9-ccb76052e824 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:25.146435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2763f2-3f1e-4bea-85d9-ccb76052e824 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:25.197364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6b60-8e61-4d93-81fb-cfd50ef6feeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:25.198037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6b60-8e61-4d93-81fb-cfd50ef6feeb admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.198416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6b60-8e61-4d93-81fb-cfd50ef6feeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.198789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee6b60-8e61-4d93-81fb-cfd50ef6feeb admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.199539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee6b60-8e61-4d93-81fb-cfd50ef6feeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:25.201520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cee6b60-8e61-4d93-81fb-cfd50ef6feeb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:25.311558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1198/2379] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:54:25 2022] POST /identity/v3/users => generated 284 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:54:25.315712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c99cc-d0b7-4831-a642-4919a545e0ec admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:25.328480 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c99cc-d0b7-4831-a642-4919a545e0ec admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:25.336106 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d558e6c-d6ba-4480-93ca-dfb926d09686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:25.336990 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d558e6c-d6ba-4480-93ca-dfb926d09686 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.337432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d558e6c-d6ba-4480-93ca-dfb926d09686 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.337712 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d558e6c-d6ba-4480-93ca-dfb926d09686 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.338394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d558e6c-d6ba-4480-93ca-dfb926d09686 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:25.340021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d558e6c-d6ba-4480-93ca-dfb926d09686 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:25.351439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1182/2380] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:25.355952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6b60-8e61-4d93-81fb-cfd50ef6feeb admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:25.373820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cee6b60-8e61-4d93-81fb-cfd50ef6feeb admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:25.378722 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4a4eb3-fe75-4461-a31d-562b688413e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:25.379968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a4eb3-fe75-4461-a31d-562b688413e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.380254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a4eb3-fe75-4461-a31d-562b688413e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.380528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4a4eb3-fe75-4461-a31d-562b688413e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.381176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a4eb3-fe75-4461-a31d-562b688413e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:25.382778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4a4eb3-fe75-4461-a31d-562b688413e6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:25.393280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1199/2381] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:54:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:54:25.398072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d558e6c-d6ba-4480-93ca-dfb926d09686 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:25.408459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d558e6c-d6ba-4480-93ca-dfb926d09686 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:25.413146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca6e59-9026-45b3-88c6-76c957e29c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:25.413804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6e59-9026-45b3-88c6-76c957e29c37 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.414085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6e59-9026-45b3-88c6-76c957e29c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.414360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca6e59-9026-45b3-88c6-76c957e29c37 admin admin] PATH_INFO: `/v3/projects/d5913bb687484ed3bd7270c0c4460b3c/users/754aa429458a44b697db13f67d852e58/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.429848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca6e59-9026-45b3-88c6-76c957e29c37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5913bb687484ed3bd7270c0c4460b3c, user_id=754aa429458a44b697db13f67d852e58, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:25.432658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ca6e59-9026-45b3-88c6-76c957e29c37 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:25.604699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1183/2382] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:54:25 2022] PUT /identity/v3/projects/d5913bb687484ed3bd7270c0c4460b3c/users/754aa429458a44b697db13f67d852e58/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:25.615537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af99e0-a58d-420f-a516-89bf342c8f78 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.615842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af99e0-a58d-420f-a516-89bf342c8f78 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.616120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19af99e0-a58d-420f-a516-89bf342c8f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.645273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155975eb-c1cf-4909-b11f-a8f8796ca06d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.646046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155975eb-c1cf-4909-b11f-a8f8796ca06d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.646046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155975eb-c1cf-4909-b11f-a8f8796ca06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.669450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-19af99e0-a58d-420f-a516-89bf342c8f78 None None] MFA Rules not processed for user `754aa429458a44b697db13f67d852e58`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:25.670698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-19af99e0-a58d-420f-a516-89bf342c8f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:25.673249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-155975eb-c1cf-4909-b11f-a8f8796ca06d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:25.674613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-155975eb-c1cf-4909-b11f-a8f8796ca06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:25.746293 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1184/2383] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:54:25.760937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155975eb-c1cf-4909-b11f-a8f8796ca06d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:25.762598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-155975eb-c1cf-4909-b11f-a8f8796ca06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:25.767645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1200/2384] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:25.779916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af99e0-a58d-420f-a516-89bf342c8f78 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:25.781545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-19af99e0-a58d-420f-a516-89bf342c8f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:25.858212 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19af99e0-a58d-420f-a516-89bf342c8f78 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:25.859120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155975eb-c1cf-4909-b11f-a8f8796ca06d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:25.862058 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4587c-13da-4dec-a7a4-017a4c3b6a94 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:25.862665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4587c-13da-4dec-a7a4-017a4c3b6a94 service glance] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.862950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4587c-13da-4dec-a7a4-017a4c3b6a94 service glance] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.863224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4587c-13da-4dec-a7a4-017a4c3b6a94 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.865596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ace94-57ae-47e7-9c55-499ed5d43236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:25.866211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ace94-57ae-47e7-9c55-499ed5d43236 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:25.866496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ace94-57ae-47e7-9c55-499ed5d43236 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:25.866773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76ace94-57ae-47e7-9c55-499ed5d43236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:25.874349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4587c-13da-4dec-a7a4-017a4c3b6a94 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:25.875816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4587c-13da-4dec-a7a4-017a4c3b6a94 service glance] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:25.875934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ace94-57ae-47e7-9c55-499ed5d43236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:25.877433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76ace94-57ae-47e7-9c55-499ed5d43236 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:25.886069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1201/2385] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:54:25.889256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1185/2386] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:26.623914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:26.727210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:29.944708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:30.016080 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:30.451933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675d5e4-82f2-4e6a-b4b6-46178563f563 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:30.457151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675d5e4-82f2-4e6a-b4b6-46178563f563 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:30.457151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1675d5e4-82f2-4e6a-b4b6-46178563f563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:30.472287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-1675d5e4-82f2-4e6a-b4b6-46178563f563 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:30.474105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1675d5e4-82f2-4e6a-b4b6-46178563f563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:30.482142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1202/2387] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:30.500401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ace94-57ae-47e7-9c55-499ed5d43236 service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:30.514410 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76ace94-57ae-47e7-9c55-499ed5d43236 service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:30.520994 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc3094-98bb-4f83-af1f-ff9a7aa37d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:30.521611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc3094-98bb-4f83-af1f-ff9a7aa37d39 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:30.521892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc3094-98bb-4f83-af1f-ff9a7aa37d39 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:30.522169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcc3094-98bb-4f83-af1f-ff9a7aa37d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:30.530968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc3094-98bb-4f83-af1f-ff9a7aa37d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:30.532597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcc3094-98bb-4f83-af1f-ff9a7aa37d39 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:30.543192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1186/2388] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:31.995543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:32.059199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:32.950151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:33.244934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:33.458980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:34.350599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:34.404622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:35.332002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:35.760465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990eb30a-a2d2-404b-a70f-df9c78318089 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:35.760926 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990eb30a-a2d2-404b-a70f-df9c78318089 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:35.761018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990eb30a-a2d2-404b-a70f-df9c78318089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:35.780845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-990eb30a-a2d2-404b-a70f-df9c78318089 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:35.782137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-990eb30a-a2d2-404b-a70f-df9c78318089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:35.790838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1203/2389] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:35.813464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc3094-98bb-4f83-af1f-ff9a7aa37d39 service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:35.825427 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcc3094-98bb-4f83-af1f-ff9a7aa37d39 service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:35.831064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90caf25-5454-472b-8ba0-d7e72323ec0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:35.831876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90caf25-5454-472b-8ba0-d7e72323ec0d service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:35.832161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90caf25-5454-472b-8ba0-d7e72323ec0d service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:35.832433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90caf25-5454-472b-8ba0-d7e72323ec0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:35.841402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90caf25-5454-472b-8ba0-d7e72323ec0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:35.843199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90caf25-5454-472b-8ba0-d7e72323ec0d service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:35.855694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1187/2390] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:36.064365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:36.439393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:37.481724 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:38.239689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:38.541535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28f9fc-01a2-48c8-b1ae-e554100e629c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:38.542002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28f9fc-01a2-48c8-b1ae-e554100e629c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:38.542093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28f9fc-01a2-48c8-b1ae-e554100e629c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:38.561410 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ea28f9fc-01a2-48c8-b1ae-e554100e629c None None] MFA Rules not processed for user `a01d3756c02c476cb051229cc6ce9bca`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:38.562632 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ea28f9fc-01a2-48c8-b1ae-e554100e629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:38.620057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1204/2391] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:38.950421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:39.571199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:40.024343 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842ad8-437c-4440-b2f2-65dd4cbdae4a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:40.025195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842ad8-437c-4440-b2f2-65dd4cbdae4a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:40.025195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70842ad8-437c-4440-b2f2-65dd4cbdae4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:40.045235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-70842ad8-437c-4440-b2f2-65dd4cbdae4a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:40.046646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-70842ad8-437c-4440-b2f2-65dd4cbdae4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:40.055352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1188/2392] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:40.147134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28f9fc-01a2-48c8-b1ae-e554100e629c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:40.147134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ea28f9fc-01a2-48c8-b1ae-e554100e629c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:40.157257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28f9fc-01a2-48c8-b1ae-e554100e629c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:40.163142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee2116-bc5b-41f6-9dfb-8c09af7f1df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:40.163899 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee2116-bc5b-41f6-9dfb-8c09af7f1df7 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:40.164071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee2116-bc5b-41f6-9dfb-8c09af7f1df7 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:40.164318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee2116-bc5b-41f6-9dfb-8c09af7f1df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:40.173513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee2116-bc5b-41f6-9dfb-8c09af7f1df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:40.175132 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee2116-bc5b-41f6-9dfb-8c09af7f1df7 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:40.184702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1205/2393] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:40.976809 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:41.230695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:41.693161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:42.333131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:43.153509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:43.999338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:44.239233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbd19-f9d5-4d7b-a236-38cb5f67bd43 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:44.243093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbd19-f9d5-4d7b-a236-38cb5f67bd43 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:44.243093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2dbd19-f9d5-4d7b-a236-38cb5f67bd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:44.259965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-df2dbd19-f9d5-4d7b-a236-38cb5f67bd43 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:44.261431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-df2dbd19-f9d5-4d7b-a236-38cb5f67bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:44.325599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1189/2394] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:54:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:44.338742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee2116-bc5b-41f6-9dfb-8c09af7f1df7 service nova] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:44.341122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-22ee2116-bc5b-41f6-9dfb-8c09af7f1df7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:44.415997 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee2116-bc5b-41f6-9dfb-8c09af7f1df7 service nova] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:44.420941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2861b779-c98b-46e6-84b0-63d9a1a82de3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:44.421542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861b779-c98b-46e6-84b0-63d9a1a82de3 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:44.421824 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861b779-c98b-46e6-84b0-63d9a1a82de3 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:44.422104 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2861b779-c98b-46e6-84b0-63d9a1a82de3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:44.430109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861b779-c98b-46e6-84b0-63d9a1a82de3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:44.431668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2861b779-c98b-46e6-84b0-63d9a1a82de3 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:44.439734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1206/2395] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:54:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:54:44.520097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:45.116828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:46.257769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:46.561922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:47.971114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:48.431381 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:48.642147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:49.166394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:49.425985 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:49.886047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:49.914472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:50.180217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:50.208194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:50.566190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:50.725495 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:50.893824 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:50.985060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:51.156872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:51.242878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:51.760144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:51.828422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:52.685870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:52.737681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:53.560429 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:53.640041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:54.405319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:54.433966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:54.759836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:55.248578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:56.177499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:56.271075 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:57.795162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:58.005999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:58.549920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dbd19-f9d5-4d7b-a236-38cb5f67bd43 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:58.551448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-df2dbd19-f9d5-4d7b-a236-38cb5f67bd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:58.565921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2dbd19-f9d5-4d7b-a236-38cb5f67bd43 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:58.571200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:58.571857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:58.572135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:58.572404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] PATH_INFO: `/v3/users/86edd5f48b4445d0a467d6493d46ff6b` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:58.573541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86edd5f48b4445d0a467d6493d46ff6b)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:58.575443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:58.891240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86edd5f48b4445d0a467d6493d46ff6b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:58.898370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86edd5f48b4445d0a467d6493d46ff6b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:58.899044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86edd5f48b4445d0a467d6493d46ff6b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:58.899709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86edd5f48b4445d0a467d6493d46ff6b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:58.982481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86edd5f48b4445d0a467d6493d46ff6b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:54:59.007745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1190/2396] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:54:58 2022] DELETE /identity/v3/users/86edd5f48b4445d0a467d6493d46ff6b => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:54:59.007856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6674c-df25-42ce-a9bd-be3502a93656 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:59.007856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6674c-df25-42ce-a9bd-be3502a93656 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:59.007856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6674c-df25-42ce-a9bd-be3502a93656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:59.026338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d2b6674c-df25-42ce-a9bd-be3502a93656 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:54:59.027570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d2b6674c-df25-42ce-a9bd-be3502a93656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:59.083680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1207/2397] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:54:59.093852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:59.095342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:59.112273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:59.158816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410be8f1-5baa-4db7-92a8-6ccf1ce3b110 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:59.162447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b88e437-1a82-4afc-bbed-807f1b2421fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:59.163058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88e437-1a82-4afc-bbed-807f1b2421fa service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:59.163922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88e437-1a82-4afc-bbed-807f1b2421fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:59.164193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b88e437-1a82-4afc-bbed-807f1b2421fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:59.174207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88e437-1a82-4afc-bbed-807f1b2421fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:59.175666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b88e437-1a82-4afc-bbed-807f1b2421fa service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:59.185238 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1191/2398] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:54:59.723764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6674c-df25-42ce-a9bd-be3502a93656 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:54:59.725272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d2b6674c-df25-42ce-a9bd-be3502a93656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:54:59.736834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6674c-df25-42ce-a9bd-be3502a93656 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:54:59.742716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:54:59.743177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:54:59.745563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:54:59.745563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] PATH_INFO: `/v3/projects/f9335db7e5d74546b1d5e69dd692cd31` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:54:59.745563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9335db7e5d74546b1d5e69dd692cd31)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:54:59.747091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:54:59.901794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:54:59.920920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9335db7e5d74546b1d5e69dd692cd31', 'request_id': 'req-77f30228-0cfd-4817-80ed-28463fe6713e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:00.053604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9335db7e5d74546b1d5e69dd692cd31', 'request_id': 'req-77f30228-0cfd-4817-80ed-28463fe6713e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:00.060387 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9335db7e5d74546b1d5e69dd692cd31', 'request_id': 'req-77f30228-0cfd-4817-80ed-28463fe6713e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:00.071544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] The token cache is being invalidate because project f9335db7e5d74546b1d5e69dd692cd31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:00.071829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:00.072464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-77f30228-0cfd-4817-80ed-28463fe6713e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:00.073941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1208/2399] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:54:59 2022] DELETE /identity/v3/projects/f9335db7e5d74546b1d5e69dd692cd31 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:00.079066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557076-78a8-4342-b6e6-5b9ef8bd9750 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.079543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557076-78a8-4342-b6e6-5b9ef8bd9750 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.079749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2557076-78a8-4342-b6e6-5b9ef8bd9750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.100074 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-c2557076-78a8-4342-b6e6-5b9ef8bd9750 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:00.101889 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c2557076-78a8-4342-b6e6-5b9ef8bd9750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:00.160693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1192/2400] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:00.168477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ee42-5272-412b-9c0a-61d1071af08c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.168764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ee42-5272-412b-9c0a-61d1071af08c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.169042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43ee42-5272-412b-9c0a-61d1071af08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.189299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-af43ee42-5272-412b-9c0a-61d1071af08c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:00.190563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-af43ee42-5272-412b-9c0a-61d1071af08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:00.199156 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1209/2401] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:00.203535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557076-78a8-4342-b6e6-5b9ef8bd9750 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:00.215139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2557076-78a8-4342-b6e6-5b9ef8bd9750 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:00.219929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b49ce5-3c4c-454d-aee6-7c7ad44b90b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:00.220563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b49ce5-3c4c-454d-aee6-7c7ad44b90b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.220846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b49ce5-3c4c-454d-aee6-7c7ad44b90b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.221181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b49ce5-3c4c-454d-aee6-7c7ad44b90b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.221866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b49ce5-3c4c-454d-aee6-7c7ad44b90b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:55:00.222175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b49ce5-3c4c-454d-aee6-7c7ad44b90b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:00.224066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b49ce5-3c4c-454d-aee6-7c7ad44b90b6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:00.236810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1193/2402] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:55:00.241065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43ee42-5272-412b-9c0a-61d1071af08c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:00.250915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43ee42-5272-412b-9c0a-61d1071af08c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:00.255580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055e89d-771b-4d8b-ac19-958db9587254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:00.256167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055e89d-771b-4d8b-ac19-958db9587254 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.256444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055e89d-771b-4d8b-ac19-958db9587254 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.256769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a055e89d-771b-4d8b-ac19-958db9587254 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.257430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055e89d-771b-4d8b-ac19-958db9587254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:00.259301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a055e89d-771b-4d8b-ac19-958db9587254 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:00.346869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1210/2403] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:55:00 2022] POST /identity/v3/projects => generated 371 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:00.351830 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b49ce5-3c4c-454d-aee6-7c7ad44b90b6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:00.362135 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b49ce5-3c4c-454d-aee6-7c7ad44b90b6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:00.439592 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e07cb-2b78-4709-8345-b4a9748dab1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:00.440391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e07cb-2b78-4709-8345-b4a9748dab1c admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.440674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e07cb-2b78-4709-8345-b4a9748dab1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.440949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e07cb-2b78-4709-8345-b4a9748dab1c admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.441599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e07cb-2b78-4709-8345-b4a9748dab1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:00.443543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e07cb-2b78-4709-8345-b4a9748dab1c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:00.502807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:00.583579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1194/2404] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:55:00 2022] POST /identity/v3/users => generated 286 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:00.588275 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055e89d-771b-4d8b-ac19-958db9587254 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:00.599905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a055e89d-771b-4d8b-ac19-958db9587254 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:00.605016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65b7c5-c672-4bca-8f5b-43fce9c697fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:00.605628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65b7c5-c672-4bca-8f5b-43fce9c697fb admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.605911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65b7c5-c672-4bca-8f5b-43fce9c697fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.606190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65b7c5-c672-4bca-8f5b-43fce9c697fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.606845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65b7c5-c672-4bca-8f5b-43fce9c697fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:00.608479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65b7c5-c672-4bca-8f5b-43fce9c697fb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:00.618870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1211/2405] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:00.622942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e07cb-2b78-4709-8345-b4a9748dab1c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:00.633064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e07cb-2b78-4709-8345-b4a9748dab1c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:00.637716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e27b0f-6118-494f-b938-ace6f6455633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:00.638434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e27b0f-6118-494f-b938-ace6f6455633 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.638716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e27b0f-6118-494f-b938-ace6f6455633 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.639198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e27b0f-6118-494f-b938-ace6f6455633 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.639797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e27b0f-6118-494f-b938-ace6f6455633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:00.641442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e27b0f-6118-494f-b938-ace6f6455633 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:00.653613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1195/2406] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:00.658077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65b7c5-c672-4bca-8f5b-43fce9c697fb admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:00.668957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65b7c5-c672-4bca-8f5b-43fce9c697fb admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:00.674781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419733c-0d22-4038-b6ee-053a0e58ecd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:00.675427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419733c-0d22-4038-b6ee-053a0e58ecd5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.675740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419733c-0d22-4038-b6ee-053a0e58ecd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.676014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9419733c-0d22-4038-b6ee-053a0e58ecd5 admin admin] PATH_INFO: `/v3/projects/2de657efa43e4c3a9f25444220af5890/users/37c4497f8a98447f86b14092ea2ff05f/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.690909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419733c-0d22-4038-b6ee-053a0e58ecd5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de657efa43e4c3a9f25444220af5890, user_id=37c4497f8a98447f86b14092ea2ff05f, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:00.693891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9419733c-0d22-4038-b6ee-053a0e58ecd5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:00.807574 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:00.813067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1212/2407] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:00 2022] PUT /identity/v3/projects/2de657efa43e4c3a9f25444220af5890/users/37c4497f8a98447f86b14092ea2ff05f/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:00.824352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760359f-9a52-4616-9c90-06fa89094136 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.824614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760359f-9a52-4616-9c90-06fa89094136 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.824980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0760359f-9a52-4616-9c90-06fa89094136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.854016 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-0760359f-9a52-4616-9c90-06fa89094136 None None] MFA Rules not processed for user `37c4497f8a98447f86b14092ea2ff05f`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:00.855234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0760359f-9a52-4616-9c90-06fa89094136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:00.918839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1196/2408] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:00.930278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419733c-0d22-4038-b6ee-053a0e58ecd5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:00.931979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9419733c-0d22-4038-b6ee-053a0e58ecd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:00.986287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9419733c-0d22-4038-b6ee-053a0e58ecd5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:00.990134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7533b3-057e-403a-81b3-8c80b234439f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:00.990762 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7533b3-057e-403a-81b3-8c80b234439f service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:00.991045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7533b3-057e-403a-81b3-8c80b234439f service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:00.991319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7533b3-057e-403a-81b3-8c80b234439f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:00.999856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7533b3-057e-403a-81b3-8c80b234439f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:01.001270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7533b3-057e-403a-81b3-8c80b234439f service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:01.010521 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1213/2409] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:01.035749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760359f-9a52-4616-9c90-06fa89094136 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:01.113868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0760359f-9a52-4616-9c90-06fa89094136 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:01.120499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:01.121645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:01.122086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:01.122540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] PATH_INFO: `/v3/users/37c4497f8a98447f86b14092ea2ff05f` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:01.124125 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c4497f8a98447f86b14092ea2ff05f)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:01.126083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:01.282691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:01.411005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c4497f8a98447f86b14092ea2ff05f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:01.418461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c4497f8a98447f86b14092ea2ff05f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:01.419119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c4497f8a98447f86b14092ea2ff05f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:01.419742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c4497f8a98447f86b14092ea2ff05f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:01.492074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:01.525452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c4497f8a98447f86b14092ea2ff05f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:01.543663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1197/2410] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:01 2022] DELETE /identity/v3/users/37c4497f8a98447f86b14092ea2ff05f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:01.548117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002d1a3-e40f-4723-927d-608b4bf490f0 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:01.548409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002d1a3-e40f-4723-927d-608b4bf490f0 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:01.548688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0002d1a3-e40f-4723-927d-608b4bf490f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:01.567308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-0002d1a3-e40f-4723-927d-608b4bf490f0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:01.568580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0002d1a3-e40f-4723-927d-608b4bf490f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:01.627538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1214/2411] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:01.637459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:01.640316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:01.695827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d29edf-dd1a-4fbe-8629-7fc233a0fb4f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:01.699671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9af6c-6a65-430c-b26f-19e5478d4984 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:01.700285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9af6c-6a65-430c-b26f-19e5478d4984 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:01.700565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9af6c-6a65-430c-b26f-19e5478d4984 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:01.700840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9af6c-6a65-430c-b26f-19e5478d4984 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:01.710088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9af6c-6a65-430c-b26f-19e5478d4984 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:01.712114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9af6c-6a65-430c-b26f-19e5478d4984 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:01.721622 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1198/2412] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:02.009070 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:02.364665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002d1a3-e40f-4723-927d-608b4bf490f0 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:02.366518 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0002d1a3-e40f-4723-927d-608b4bf490f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:02.379329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0002d1a3-e40f-4723-927d-608b4bf490f0 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:02.384761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:02.385418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:02.385709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:02.385984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] PATH_INFO: `/v3/projects/2de657efa43e4c3a9f25444220af5890` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:02.387158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de657efa43e4c3a9f25444220af5890)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:02.389210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:02.471267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=81,keystone:INSERT=3,keystone:DELETE=16 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:02.624270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de657efa43e4c3a9f25444220af5890', 'request_id': 'req-0be86856-2d2a-4429-be7c-7f8e420a9663'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:02.769481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9af6c-6a65-430c-b26f-19e5478d4984 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:02.771255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d5a9af6c-6a65-430c-b26f-19e5478d4984 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:02.807485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de657efa43e4c3a9f25444220af5890', 'request_id': 'req-0be86856-2d2a-4429-be7c-7f8e420a9663'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:02.816541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de657efa43e4c3a9f25444220af5890', 'request_id': 'req-0be86856-2d2a-4429-be7c-7f8e420a9663'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:02.831742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] The token cache is being invalidate because project 2de657efa43e4c3a9f25444220af5890 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:02.831865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:02.832494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0be86856-2d2a-4429-be7c-7f8e420a9663 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:02.834221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1215/2413] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:02 2022] DELETE /identity/v3/projects/2de657efa43e4c3a9f25444220af5890 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:02.844037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e381a72-e52a-44a7-b180-9fa4fabf9db8 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:02.844397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9af6c-6a65-430c-b26f-19e5478d4984 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:02.844645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e381a72-e52a-44a7-b180-9fa4fabf9db8 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:02.844937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e381a72-e52a-44a7-b180-9fa4fabf9db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:02.897271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-0e381a72-e52a-44a7-b180-9fa4fabf9db8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:02.905591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0e381a72-e52a-44a7-b180-9fa4fabf9db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:02.954265 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004ea48-e6cd-49f2-b6f5-57a756b33271 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:02.954986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004ea48-e6cd-49f2-b6f5-57a756b33271 service placement] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:02.957294 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004ea48-e6cd-49f2-b6f5-57a756b33271 service placement] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:02.957294 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004ea48-e6cd-49f2-b6f5-57a756b33271 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:02.965047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a004ea48-e6cd-49f2-b6f5-57a756b33271 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:02.981529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004ea48-e6cd-49f2-b6f5-57a756b33271 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:02.983719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004ea48-e6cd-49f2-b6f5-57a756b33271 service placement] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:02.991968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1216/2414] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:02.994511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1199/2415] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:55:02.995773 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e89b6-6c9a-4e4e-9a5d-963c361959f2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:02.996339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e89b6-6c9a-4e4e-9a5d-963c361959f2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:02.996679 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e89b6-6c9a-4e4e-9a5d-963c361959f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.018431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-7d8e89b6-6c9a-4e4e-9a5d-963c361959f2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:03.019755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7d8e89b6-6c9a-4e4e-9a5d-963c361959f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:03.031316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1217/2416] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:03.035123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004ea48-e6cd-49f2-b6f5-57a756b33271 service placement] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.049430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004ea48-e6cd-49f2-b6f5-57a756b33271 service placement] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:03.054152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f90dad-6882-4ddf-9faf-df918809f62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:03.055073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90dad-6882-4ddf-9faf-df918809f62e admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.055378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90dad-6882-4ddf-9faf-df918809f62e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.055688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f90dad-6882-4ddf-9faf-df918809f62e admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.056347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f90dad-6882-4ddf-9faf-df918809f62e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:55:03.056656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f90dad-6882-4ddf-9faf-df918809f62e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:03.058377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f90dad-6882-4ddf-9faf-df918809f62e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:03.076941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e89b6-6c9a-4e4e-9a5d-963c361959f2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.077620 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1200/2417] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:55:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:55:03.091845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e89b6-6c9a-4e4e-9a5d-963c361959f2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:03.097141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194b448-6347-4039-a2c7-d02d9c51372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:03.099255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194b448-6347-4039-a2c7-d02d9c51372e admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.099573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194b448-6347-4039-a2c7-d02d9c51372e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.099870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f194b448-6347-4039-a2c7-d02d9c51372e admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.100633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194b448-6347-4039-a2c7-d02d9c51372e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:03.103090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f194b448-6347-4039-a2c7-d02d9c51372e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:03.246234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:03.253616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1218/2418] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:55:03 2022] POST /identity/v3/projects => generated 391 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:03.263691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f90dad-6882-4ddf-9faf-df918809f62e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.274929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f90dad-6882-4ddf-9faf-df918809f62e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:03.351490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dffcff-76ad-41a5-96e6-2a8ffa87baa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:03.352693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dffcff-76ad-41a5-96e6-2a8ffa87baa0 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.353022 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dffcff-76ad-41a5-96e6-2a8ffa87baa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.353300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dffcff-76ad-41a5-96e6-2a8ffa87baa0 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.353955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dffcff-76ad-41a5-96e6-2a8ffa87baa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:03.356081 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dffcff-76ad-41a5-96e6-2a8ffa87baa0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:03.501313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1201/2419] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:55:03 2022] POST /identity/v3/users => generated 296 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:55:03.502706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194b448-6347-4039-a2c7-d02d9c51372e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.513493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f194b448-6347-4039-a2c7-d02d9c51372e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:03.519435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88eddb8-95ce-4e10-88be-ab7e3c728b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:03.519696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88eddb8-95ce-4e10-88be-ab7e3c728b37 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.519980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88eddb8-95ce-4e10-88be-ab7e3c728b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.520255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88eddb8-95ce-4e10-88be-ab7e3c728b37 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.520919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88eddb8-95ce-4e10-88be-ab7e3c728b37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:03.522507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88eddb8-95ce-4e10-88be-ab7e3c728b37 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:03.536528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1219/2420] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:03.537967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dffcff-76ad-41a5-96e6-2a8ffa87baa0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.556106 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dffcff-76ad-41a5-96e6-2a8ffa87baa0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:03.561988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b098a43f-7a42-4c4b-86b6-c3061f2e13e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:03.562710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098a43f-7a42-4c4b-86b6-c3061f2e13e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.563100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098a43f-7a42-4c4b-86b6-c3061f2e13e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.563477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b098a43f-7a42-4c4b-86b6-c3061f2e13e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.565149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098a43f-7a42-4c4b-86b6-c3061f2e13e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:03.568552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b098a43f-7a42-4c4b-86b6-c3061f2e13e1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:03.601621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1202/2421] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:55:03 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:55:03.606040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88eddb8-95ce-4e10-88be-ab7e3c728b37 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.617957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88eddb8-95ce-4e10-88be-ab7e3c728b37 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:03.622757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877cf2c-63b0-4828-9ebf-e757475dd0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:03.623427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877cf2c-63b0-4828-9ebf-e757475dd0a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.623765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877cf2c-63b0-4828-9ebf-e757475dd0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.624048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3877cf2c-63b0-4828-9ebf-e757475dd0a7 admin admin] PATH_INFO: `/v3/projects/f21e7f1840dd4da6befa4fd5bdb5df35/users/e3295fc7317f485b9f8e590aaee60a04/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.640846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877cf2c-63b0-4828-9ebf-e757475dd0a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21e7f1840dd4da6befa4fd5bdb5df35, user_id=e3295fc7317f485b9f8e590aaee60a04, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:03.644386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3877cf2c-63b0-4828-9ebf-e757475dd0a7 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:03.855741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1220/2422] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:55:03 2022] PUT /identity/v3/projects/f21e7f1840dd4da6befa4fd5bdb5df35/users/e3295fc7317f485b9f8e590aaee60a04/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:03.866532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633a47-fc07-4f27-8da8-60be6b5c0f84 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:03.867740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633a47-fc07-4f27-8da8-60be6b5c0f84 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:03.867740 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d633a47-fc07-4f27-8da8-60be6b5c0f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:03.896193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-9d633a47-fc07-4f27-8da8-60be6b5c0f84 None None] MFA Rules not processed for user `e3295fc7317f485b9f8e590aaee60a04`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:03.897685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9d633a47-fc07-4f27-8da8-60be6b5c0f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:03.965133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1203/2423] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:03 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:03.990876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877cf2c-63b0-4828-9ebf-e757475dd0a7 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:03.993279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3877cf2c-63b0-4828-9ebf-e757475dd0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:04.051225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3877cf2c-63b0-4828-9ebf-e757475dd0a7 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:04.055501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f43ee-7790-4b3c-95e6-3320c74be8d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:04.056141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f43ee-7790-4b3c-95e6-3320c74be8d3 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:04.056423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f43ee-7790-4b3c-95e6-3320c74be8d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:04.056700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309f43ee-7790-4b3c-95e6-3320c74be8d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:04.065708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f43ee-7790-4b3c-95e6-3320c74be8d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:04.067099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309f43ee-7790-4b3c-95e6-3320c74be8d3 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:04.077890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1221/2424] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:04.260166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:04.908186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e6834-dd95-4a2c-af86-46b6b6def9d9 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:04.908692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e6834-dd95-4a2c-af86-46b6b6def9d9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:04.908806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e6834-dd95-4a2c-af86-46b6b6def9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:04.929979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-636e6834-dd95-4a2c-af86-46b6b6def9d9 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:04.931110 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-636e6834-dd95-4a2c-af86-46b6b6def9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:05.018408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1204/2425] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 08:55:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:05.053532 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f43ee-7790-4b3c-95e6-3320c74be8d3 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:05.056260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-309f43ee-7790-4b3c-95e6-3320c74be8d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:05.166512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309f43ee-7790-4b3c-95e6-3320c74be8d3 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:05.171667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b109a57b-c844-4ab8-9ff2-7c63427a0d90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:05.172282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a57b-c844-4ab8-9ff2-7c63427a0d90 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:05.172564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a57b-c844-4ab8-9ff2-7c63427a0d90 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:05.172851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b109a57b-c844-4ab8-9ff2-7c63427a0d90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:05.194468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109a57b-c844-4ab8-9ff2-7c63427a0d90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:05.198974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b109a57b-c844-4ab8-9ff2-7c63427a0d90 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:05.213236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1222/2426] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:55:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:55:06.008950 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e6834-dd95-4a2c-af86-46b6b6def9d9 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:06.010392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-636e6834-dd95-4a2c-af86-46b6b6def9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:06.082371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e6834-dd95-4a2c-af86-46b6b6def9d9 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:06.088446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:06.089318 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.090138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.090494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] PATH_INFO: `/v3/users/754aa429458a44b697db13f67d852e58` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.091707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] RBAC: Authorizing `identity:delete_user(user_id=754aa429458a44b697db13f67d852e58)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:06.093714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:06.458757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '754aa429458a44b697db13f67d852e58'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:06.477438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '754aa429458a44b697db13f67d852e58'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:06.481099 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '754aa429458a44b697db13f67d852e58'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:06.482778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '754aa429458a44b697db13f67d852e58'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:06.569249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '754aa429458a44b697db13f67d852e58'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:06.596364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1205/2427] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:06 2022] DELETE /identity/v3/users/754aa429458a44b697db13f67d852e58 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:55:06.602066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62afa0-9b73-4a68-b670-333316bc33b0 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.602537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62afa0-9b73-4a68-b670-333316bc33b0 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.602681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62afa0-9b73-4a68-b670-333316bc33b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.622135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ad62afa0-9b73-4a68-b670-333316bc33b0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:06.623372 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ad62afa0-9b73-4a68-b670-333316bc33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:06.736873 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1223/2428] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:06.747330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:06.749157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:06.846539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecdf01-1bfa-47e8-924c-d1b68cb9b354 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:06.854937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371ce2c-b7ae-4226-9697-69044ddfa66d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:06.855775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371ce2c-b7ae-4226-9697-69044ddfa66d service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:06.856155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371ce2c-b7ae-4226-9697-69044ddfa66d service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:06.856528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371ce2c-b7ae-4226-9697-69044ddfa66d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:06.869282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371ce2c-b7ae-4226-9697-69044ddfa66d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:06.871264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371ce2c-b7ae-4226-9697-69044ddfa66d service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:06.897492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1206/2429] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:55:06.995822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:07.496952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62afa0-9b73-4a68-b670-333316bc33b0 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:07.499653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ad62afa0-9b73-4a68-b670-333316bc33b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:07.514243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62afa0-9b73-4a68-b670-333316bc33b0 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:07.520389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:07.521208 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:07.521618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:07.521963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] PATH_INFO: `/v3/projects/d5913bb687484ed3bd7270c0c4460b3c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:07.523811 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5913bb687484ed3bd7270c0c4460b3c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:07.531249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:07.740181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5913bb687484ed3bd7270c0c4460b3c', 'request_id': 'req-dda5f08a-04ce-4890-b605-0cb268cb4047'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:07.844351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5913bb687484ed3bd7270c0c4460b3c', 'request_id': 'req-dda5f08a-04ce-4890-b605-0cb268cb4047'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:07.857267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5913bb687484ed3bd7270c0c4460b3c', 'request_id': 'req-dda5f08a-04ce-4890-b605-0cb268cb4047'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:07.883305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] The token cache is being invalidate because project d5913bb687484ed3bd7270c0c4460b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:07.883826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:07.884725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:07.889710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1224/2430] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:07 2022] DELETE /identity/v3/projects/d5913bb687484ed3bd7270c0c4460b3c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:08.814232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:10.020008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:10.266354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:12.105992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:12.174627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:12.914784 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121b745-936e-4dbe-bad4-b4121e167824 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:12.915087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121b745-936e-4dbe-bad4-b4121e167824 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:12.919652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a121b745-936e-4dbe-bad4-b4121e167824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:12.938960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a121b745-936e-4dbe-bad4-b4121e167824 None None] MFA Rules not processed for user `46e426b17c7543fb8cdaf0adff89b667`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:12.940202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a121b745-936e-4dbe-bad4-b4121e167824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:12.999085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1207/2431] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:13.007783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:13.352446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:13.652910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:15.174489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:15.323192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:15.585854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:15.705818 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:15.797593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:16.235639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:16.589691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:17.461448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:17.614627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:18.119298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.121059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:18.230947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda5f08a-04ce-4890-b605-0cb268cb4047 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:18.238335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:18.241495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.241495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.241495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] PATH_INFO: `/v3/users/e3295fc7317f485b9f8e590aaee60a04` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.241495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3295fc7317f485b9f8e590aaee60a04)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:18.244056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:18.649004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3295fc7317f485b9f8e590aaee60a04'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.657882 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3295fc7317f485b9f8e590aaee60a04'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.658837 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3295fc7317f485b9f8e590aaee60a04'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.659665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3295fc7317f485b9f8e590aaee60a04'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.755423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3295fc7317f485b9f8e590aaee60a04'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:18.794595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1225/2432] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:18 2022] DELETE /identity/v3/users/e3295fc7317f485b9f8e590aaee60a04 => generated 0 bytes in 676 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:18.802898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66471061-b52e-415f-8c11-49df312f54a9 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:18.803383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66471061-b52e-415f-8c11-49df312f54a9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:18.803635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66471061-b52e-415f-8c11-49df312f54a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:18.874461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-66471061-b52e-415f-8c11-49df312f54a9 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:18.878454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-66471061-b52e-415f-8c11-49df312f54a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:18.966257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1208/2433] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:18.977883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:18.979360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:19.070378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fa7f4-ba2e-4a96-990c-84cc10afb6fe admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:19.074671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc23ab-6f17-4503-be1f-ac2c6101414e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:19.075290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc23ab-6f17-4503-be1f-ac2c6101414e service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:19.075649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc23ab-6f17-4503-be1f-ac2c6101414e service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:19.075934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc23ab-6f17-4503-be1f-ac2c6101414e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:19.091848 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc23ab-6f17-4503-be1f-ac2c6101414e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:19.092242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc23ab-6f17-4503-be1f-ac2c6101414e service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:19.111364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1226/2434] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:19.156448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:19.758766 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66471061-b52e-415f-8c11-49df312f54a9 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:19.760789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-66471061-b52e-415f-8c11-49df312f54a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:19.778196 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66471061-b52e-415f-8c11-49df312f54a9 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:19.786654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:19.786654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:19.786654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:19.786654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] PATH_INFO: `/v3/projects/f21e7f1840dd4da6befa4fd5bdb5df35` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:19.787375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21e7f1840dd4da6befa4fd5bdb5df35)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:19.789598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:20.014613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21e7f1840dd4da6befa4fd5bdb5df35', 'request_id': 'req-f26857b9-50c0-473e-af05-59ee609ee63e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:20.139412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21e7f1840dd4da6befa4fd5bdb5df35', 'request_id': 'req-f26857b9-50c0-473e-af05-59ee609ee63e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:20.146185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21e7f1840dd4da6befa4fd5bdb5df35', 'request_id': 'req-f26857b9-50c0-473e-af05-59ee609ee63e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:20.157561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] The token cache is being invalidate because project f21e7f1840dd4da6befa4fd5bdb5df35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:20.157860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:20.158518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f26857b9-50c0-473e-af05-59ee609ee63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:20.160470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1209/2435] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:19 2022] DELETE /identity/v3/projects/f21e7f1840dd4da6befa4fd5bdb5df35 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:20.230139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:20.683737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:21.620520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:21.963933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:23.049456 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:23.295271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:24.255401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:24.575306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:25.049940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdeda2-4b3a-4ffb-a049-6248dd31b6c1 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:25.050226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdeda2-4b3a-4ffb-a049-6248dd31b6c1 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:25.058398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbdeda2-4b3a-4ffb-a049-6248dd31b6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:25.070013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-0bbdeda2-4b3a-4ffb-a049-6248dd31b6c1 None None] MFA Rules not processed for user `b9aef63cad18473994760d8bbc6faae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:25.071222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0bbdeda2-4b3a-4ffb-a049-6248dd31b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:25.125923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1227/2436] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:25.721459 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:26.249202 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:27.235886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:28.392539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:28.606821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f7a47-4dc3-4e4e-bc01-d09868cd0c0f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:28.607103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f7a47-4dc3-4e4e-bc01-d09868cd0c0f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:28.607386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f7a47-4dc3-4e4e-bc01-d09868cd0c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:28.627779 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-783f7a47-4dc3-4e4e-bc01-d09868cd0c0f None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:28.629059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-783f7a47-4dc3-4e4e-bc01-d09868cd0c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:28.687211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1210/2437] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:55:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:28.700081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdeda2-4b3a-4ffb-a049-6248dd31b6c1 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:28.701482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-0bbdeda2-4b3a-4ffb-a049-6248dd31b6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:28.776535 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbdeda2-4b3a-4ffb-a049-6248dd31b6c1 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:28.781449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf2982-8cd6-4d4b-bec6-62097c680bd0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:28.782042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf2982-8cd6-4d4b-bec6-62097c680bd0 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:28.782320 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf2982-8cd6-4d4b-bec6-62097c680bd0 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:28.782591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf2982-8cd6-4d4b-bec6-62097c680bd0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:28.790421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf2982-8cd6-4d4b-bec6-62097c680bd0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:28.792003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bf2982-8cd6-4d4b-bec6-62097c680bd0 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:28.799661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1228/2438] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:55:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:55:28.884195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:29.343462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:29.470882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:30.522013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:30.685432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:31.095334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:31.144857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:31.316034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:31.416097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:36.417145 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d304be4-34bd-4f39-ae83-80f0529c2a7a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:36.417895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d304be4-34bd-4f39-ae83-80f0529c2a7a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:36.417895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d304be4-34bd-4f39-ae83-80f0529c2a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:36.454417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7d304be4-34bd-4f39-ae83-80f0529c2a7a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:36.455800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7d304be4-34bd-4f39-ae83-80f0529c2a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:36.532923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1211/2439] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:36.560468 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf2982-8cd6-4d4b-bec6-62097c680bd0 service swift] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:36.562482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-76bf2982-8cd6-4d4b-bec6-62097c680bd0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:36.631597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:36.686654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf2982-8cd6-4d4b-bec6-62097c680bd0 service swift] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:36.696520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e319-67aa-4c20-854b-4321c32b02fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:36.697769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e319-67aa-4c20-854b-4321c32b02fb service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:36.697769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e319-67aa-4c20-854b-4321c32b02fb service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:36.698309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80e319-67aa-4c20-854b-4321c32b02fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:36.713272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80e319-67aa-4c20-854b-4321c32b02fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:36.723360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab80e319-67aa-4c20-854b-4321c32b02fb service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:36.736925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1229/2440] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:42.361947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965092d-f1f2-4943-b782-f8a2cb863692 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:42.362640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965092d-f1f2-4943-b782-f8a2cb863692 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:42.362640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1965092d-f1f2-4943-b782-f8a2cb863692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:42.390936 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1965092d-f1f2-4943-b782-f8a2cb863692 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:42.392278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1965092d-f1f2-4943-b782-f8a2cb863692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:42.401609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1212/2441] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:42.424462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e319-67aa-4c20-854b-4321c32b02fb service nova] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:42.426008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ab80e319-67aa-4c20-854b-4321c32b02fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:42.446306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80e319-67aa-4c20-854b-4321c32b02fb service nova] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:42.452304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f004-9a22-472c-be40-b866dda9b9b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:42.463542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f004-9a22-472c-be40-b866dda9b9b5 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:42.463542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f004-9a22-472c-be40-b866dda9b9b5 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:42.463542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5f004-9a22-472c-be40-b866dda9b9b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:42.470396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5f004-9a22-472c-be40-b866dda9b9b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:42.472448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb5f004-9a22-472c-be40-b866dda9b9b5 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:42.487703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1230/2442] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:45.780743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ecf5-8a14-4964-9612-ee47b4564ca8 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:45.781223 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ecf5-8a14-4964-9612-ee47b4564ca8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:45.781607 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2595ecf5-8a14-4964-9612-ee47b4564ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:45.802643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-2595ecf5-8a14-4964-9612-ee47b4564ca8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:45.804364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2595ecf5-8a14-4964-9612-ee47b4564ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:45.813728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1213/2443] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:45.842330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f004-9a22-472c-be40-b866dda9b9b5 service nova] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:45.855156 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb5f004-9a22-472c-be40-b866dda9b9b5 service nova] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:45.861304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fca9a6-c0cc-4685-8a9e-759cc6133855 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:45.862034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fca9a6-c0cc-4685-8a9e-759cc6133855 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:45.862386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fca9a6-c0cc-4685-8a9e-759cc6133855 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:45.862727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fca9a6-c0cc-4685-8a9e-759cc6133855 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:45.872993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fca9a6-c0cc-4685-8a9e-759cc6133855 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:45.874607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fca9a6-c0cc-4685-8a9e-759cc6133855 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:45.893916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1231/2444] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:47.290372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143b66-1992-4a79-b800-3951da658b96 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:47.295374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143b66-1992-4a79-b800-3951da658b96 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:47.295374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55143b66-1992-4a79-b800-3951da658b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:47.305303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:47.311911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-55143b66-1992-4a79-b800-3951da658b96 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:47.313187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-55143b66-1992-4a79-b800-3951da658b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:47.321285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1214/2445] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 08:55:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:47.336697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fca9a6-c0cc-4685-8a9e-759cc6133855 service nova] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:47.348594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fca9a6-c0cc-4685-8a9e-759cc6133855 service nova] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:47.354019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fdba4-9814-48f0-9a14-b4ab5ed57d36 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:47.355147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fdba4-9814-48f0-9a14-b4ab5ed57d36 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:47.355482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fdba4-9814-48f0-9a14-b4ab5ed57d36 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:47.355799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fdba4-9814-48f0-9a14-b4ab5ed57d36 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:47.364330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fdba4-9814-48f0-9a14-b4ab5ed57d36 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:47.365896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fdba4-9814-48f0-9a14-b4ab5ed57d36 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:47.374933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1232/2446] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:55:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:55:50.091354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de8e3-7c0c-413d-92b9-93dcc488ec9f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:50.092008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de8e3-7c0c-413d-92b9-93dcc488ec9f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:50.092008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de8e3-7c0c-413d-92b9-93dcc488ec9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:50.133366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-c86de8e3-7c0c-413d-92b9-93dcc488ec9f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:50.134774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c86de8e3-7c0c-413d-92b9-93dcc488ec9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:50.143131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1215/2447] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:50.174810 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fdba4-9814-48f0-9a14-b4ab5ed57d36 service swift] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:50.189859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fdba4-9814-48f0-9a14-b4ab5ed57d36 service swift] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:50.195562 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe231dc-ac02-4f4a-a729-75a24b34c7dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:50.196117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe231dc-ac02-4f4a-a729-75a24b34c7dc service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:50.196402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe231dc-ac02-4f4a-a729-75a24b34c7dc service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:50.196681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe231dc-ac02-4f4a-a729-75a24b34c7dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:50.206691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe231dc-ac02-4f4a-a729-75a24b34c7dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:50.208451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe231dc-ac02-4f4a-a729-75a24b34c7dc service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:50.219099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1233/2448] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:55:50.281042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae827c97-6769-4066-bf9c-b3ebce983acc None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:50.281317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae827c97-6769-4066-bf9c-b3ebce983acc None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:50.281593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae827c97-6769-4066-bf9c-b3ebce983acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:50.300928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-ae827c97-6769-4066-bf9c-b3ebce983acc None None] MFA Rules not processed for user `2d5f07704f014ae7a4997fca3c2faa6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:50.302141 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ae827c97-6769-4066-bf9c-b3ebce983acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:50.357454 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1216/2449] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:55:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:50.781977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe231dc-ac02-4f4a-a729-75a24b34c7dc service nova] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:50.783395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fbe231dc-ac02-4f4a-a729-75a24b34c7dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:50.796142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe231dc-ac02-4f4a-a729-75a24b34c7dc service nova] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:50.800856 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:50.801475 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:50.801755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:50.802025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] PATH_INFO: `/v3/users/a01d3756c02c476cb051229cc6ce9bca` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:50.803137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01d3756c02c476cb051229cc6ce9bca)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:50.805142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:51.036407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01d3756c02c476cb051229cc6ce9bca'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.044758 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01d3756c02c476cb051229cc6ce9bca'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.044928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01d3756c02c476cb051229cc6ce9bca'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.045482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01d3756c02c476cb051229cc6ce9bca'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.129967 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4fc9009a-e1fa-4b66-bb64-77b61ffcdee5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01d3756c02c476cb051229cc6ce9bca'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.148869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1234/2450] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:55:50 2022] DELETE /identity/v3/users/a01d3756c02c476cb051229cc6ce9bca => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:51.457770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae827c97-6769-4066-bf9c-b3ebce983acc None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:51.483271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae827c97-6769-4066-bf9c-b3ebce983acc None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:51.540768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:51.541394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:51.541672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:51.541945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] PATH_INFO: `/v3/projects/9cf92844fe1140b3a74903a3491bef3a` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:51.543664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf92844fe1140b3a74903a3491bef3a)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:51.545553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:51.671234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf92844fe1140b3a74903a3491bef3a', 'request_id': 'req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.758751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf92844fe1140b3a74903a3491bef3a', 'request_id': 'req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.765503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf92844fe1140b3a74903a3491bef3a', 'request_id': 'req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.775907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] The token cache is being invalidate because project 9cf92844fe1140b3a74903a3491bef3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:55:51.776192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.777374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:55:51.778922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1217/2451] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:55:51 2022] DELETE /identity/v3/projects/9cf92844fe1140b3a74903a3491bef3a => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:55:55.373600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f71c-05e4-42d6-91e2-e6d1fe7e9a9f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:55.374112 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f71c-05e4-42d6-91e2-e6d1fe7e9a9f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:55.374210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc2f71c-05e4-42d6-91e2-e6d1fe7e9a9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:55.395117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9dc2f71c-05e4-42d6-91e2-e6d1fe7e9a9f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:55:55.396381 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9dc2f71c-05e4-42d6-91e2-e6d1fe7e9a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:55.442939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:55.464511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1235/2452] 10.222.0.36 () {58 vars in 1016 bytes} [Tue Oct 4 08:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:55:55.479137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:55:55.480732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:55:55.521720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:55:55.567144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0738fe7-d5be-46c2-a0e1-71963b94e9c4 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:55:55.574057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f24b4-bc75-492d-8035-03311ed71c5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:55:55.575134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f24b4-bc75-492d-8035-03311ed71c5b service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:55:55.575423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f24b4-bc75-492d-8035-03311ed71c5b service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:55:55.575730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f24b4-bc75-492d-8035-03311ed71c5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:55:55.584310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f24b4-bc75-492d-8035-03311ed71c5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:55:55.585958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7f24b4-bc75-492d-8035-03311ed71c5b service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:55:55.596668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1218/2453] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:03.227031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdfda-d6ff-4bc8-b479-342a38a46aad None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:03.227802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdfda-d6ff-4bc8-b479-342a38a46aad None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:03.227898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00cdfda-d6ff-4bc8-b479-342a38a46aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:03.246375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-e00cdfda-d6ff-4bc8-b479-342a38a46aad None None] MFA Rules not processed for user `35b0d1ed01c344acb96ab00c7c163e18`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:03.247637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e00cdfda-d6ff-4bc8-b479-342a38a46aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:03.300692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1236/2454] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:05.735810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=21 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:13.293930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=32 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:29.895995 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f24b4-bc75-492d-8035-03311ed71c5b service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:29.905703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ff7f24b4-bc75-492d-8035-03311ed71c5b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:29.911155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f24b4-bc75-492d-8035-03311ed71c5b service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:29.915813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:29.916437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:29.916715 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:29.916990 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] PATH_INFO: `/v3/users/46e426b17c7543fb8cdaf0adff89b667` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:29.918105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46e426b17c7543fb8cdaf0adff89b667)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:29.920072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:30.149970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46e426b17c7543fb8cdaf0adff89b667'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.157103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46e426b17c7543fb8cdaf0adff89b667'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.157822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46e426b17c7543fb8cdaf0adff89b667'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.158432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46e426b17c7543fb8cdaf0adff89b667'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.239075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c989f9dc-50db-4f71-adf3-dcf9c510c573 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46e426b17c7543fb8cdaf0adff89b667'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.258211 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1219/2455] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:56:29 2022] DELETE /identity/v3/users/46e426b17c7543fb8cdaf0adff89b667 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:30.516364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cdfda-d6ff-4bc8-b479-342a38a46aad None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:30.528228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00cdfda-d6ff-4bc8-b479-342a38a46aad None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:30.584717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:30.585350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.585633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.585909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] PATH_INFO: `/v3/projects/103c8390284f4076a54932ff458cff38` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.587018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] RBAC: Authorizing `identity:delete_project(project_id=103c8390284f4076a54932ff458cff38)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:30.588979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:30.759628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '103c8390284f4076a54932ff458cff38', 'request_id': 'req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.857258 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '103c8390284f4076a54932ff458cff38', 'request_id': 'req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.867705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '103c8390284f4076a54932ff458cff38', 'request_id': 'req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.876046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] The token cache is being invalidate because project 103c8390284f4076a54932ff458cff38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:56:30.876342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.876987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b46f34b3-61e3-4ba4-a7a3-40fa4c0bb065 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:30.878449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1237/2456] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:56:30 2022] DELETE /identity/v3/projects/103c8390284f4076a54932ff458cff38 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:30.883231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c987-8434-4864-9aa1-442afe088b5d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.883535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c987-8434-4864-9aa1-442afe088b5d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.883850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86c987-8434-4864-9aa1-442afe088b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:30.904140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-0d86c987-8434-4864-9aa1-442afe088b5d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:30.907749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0d86c987-8434-4864-9aa1-442afe088b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:30.969751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1220/2457] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:30.978066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94556e42-f59f-463e-a9e4-1db4f672f2cd None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:30.978447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94556e42-f59f-463e-a9e4-1db4f672f2cd None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:30.978794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94556e42-f59f-463e-a9e4-1db4f672f2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:31.000649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-94556e42-f59f-463e-a9e4-1db4f672f2cd None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:31.005317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-94556e42-f59f-463e-a9e4-1db4f672f2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:31.010457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1238/2458] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:31.014657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c987-8434-4864-9aa1-442afe088b5d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:31.025117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86c987-8434-4864-9aa1-442afe088b5d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:31.029926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6ad2d-546a-4115-aa31-648e1a316d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:31.030539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6ad2d-546a-4115-aa31-648e1a316d6d admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:31.030815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6ad2d-546a-4115-aa31-648e1a316d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:31.031087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b6ad2d-546a-4115-aa31-648e1a316d6d admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:31.031770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6ad2d-546a-4115-aa31-648e1a316d6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:56:31.032077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6ad2d-546a-4115-aa31-648e1a316d6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:31.033661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b6ad2d-546a-4115-aa31-648e1a316d6d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:31.050507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1221/2459] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:56:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:56:31.051432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94556e42-f59f-463e-a9e4-1db4f672f2cd None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:31.060796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94556e42-f59f-463e-a9e4-1db4f672f2cd None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:31.065580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5bb4b-dbe4-4f43-8375-ccb875e3b621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:31.066137 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5bb4b-dbe4-4f43-8375-ccb875e3b621 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:31.066435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5bb4b-dbe4-4f43-8375-ccb875e3b621 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:31.066704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a5bb4b-dbe4-4f43-8375-ccb875e3b621 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:31.067958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5bb4b-dbe4-4f43-8375-ccb875e3b621 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:31.069876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a5bb4b-dbe4-4f43-8375-ccb875e3b621 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:31.158039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1239/2460] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:56:31 2022] POST /identity/v3/projects => generated 397 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:56:31.159589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6ad2d-546a-4115-aa31-648e1a316d6d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:31.170300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b6ad2d-546a-4115-aa31-648e1a316d6d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:31.227464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbb841-c418-414c-9f4d-90a53ef8265b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:31.228107 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbb841-c418-414c-9f4d-90a53ef8265b admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:31.228387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbb841-c418-414c-9f4d-90a53ef8265b admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:31.228660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbb841-c418-414c-9f4d-90a53ef8265b admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:31.229295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbb841-c418-414c-9f4d-90a53ef8265b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:31.231455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fbb841-c418-414c-9f4d-90a53ef8265b admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:31.239651 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:31.336655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1222/2461] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:56:31 2022] POST /identity/v3/users => generated 299 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:56:31.340664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5bb4b-dbe4-4f43-8375-ccb875e3b621 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:31.351306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a5bb4b-dbe4-4f43-8375-ccb875e3b621 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:31.356470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0a4d7-fe8d-40ef-8241-80e0bf34c739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:31.357061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0a4d7-fe8d-40ef-8241-80e0bf34c739 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:31.357344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0a4d7-fe8d-40ef-8241-80e0bf34c739 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:31.357670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb0a4d7-fe8d-40ef-8241-80e0bf34c739 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:31.358319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0a4d7-fe8d-40ef-8241-80e0bf34c739 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:31.359989 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb0a4d7-fe8d-40ef-8241-80e0bf34c739 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:31.370764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1240/2462] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:56:31.378313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbb841-c418-414c-9f4d-90a53ef8265b admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:31.388625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbb841-c418-414c-9f4d-90a53ef8265b admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:31.393198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142d6a84-ccf7-4016-87da-80dfe59a0498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:31.393794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d6a84-ccf7-4016-87da-80dfe59a0498 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:31.394069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d6a84-ccf7-4016-87da-80dfe59a0498 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:31.394964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142d6a84-ccf7-4016-87da-80dfe59a0498 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:31.395733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d6a84-ccf7-4016-87da-80dfe59a0498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:31.397311 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142d6a84-ccf7-4016-87da-80dfe59a0498 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:31.407683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1223/2463] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:56:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:56:31.412712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0a4d7-fe8d-40ef-8241-80e0bf34c739 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:31.422511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb0a4d7-fe8d-40ef-8241-80e0bf34c739 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:31.427242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8dec-1cef-4e12-8788-1669b49da6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:31.428280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8dec-1cef-4e12-8788-1669b49da6a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:31.428280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8dec-1cef-4e12-8788-1669b49da6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:31.428541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad8dec-1cef-4e12-8788-1669b49da6a9 admin admin] PATH_INFO: `/v3/projects/8564a7210b4e48c68cc664b049c00275/users/e2bee8738ab74f1e860da7fc05b64e6a/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:31.443872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad8dec-1cef-4e12-8788-1669b49da6a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8564a7210b4e48c68cc664b049c00275, user_id=e2bee8738ab74f1e860da7fc05b64e6a, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:31.446505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ad8dec-1cef-4e12-8788-1669b49da6a9 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:31.541607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1241/2464] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:56:31 2022] PUT /identity/v3/projects/8564a7210b4e48c68cc664b049c00275/users/e2bee8738ab74f1e860da7fc05b64e6a/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:31.556524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c0d2-3d7a-443d-bb30-34e982c4cc31 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:31.556805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c0d2-3d7a-443d-bb30-34e982c4cc31 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:31.557076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f284c0d2-3d7a-443d-bb30-34e982c4cc31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:31.588278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f284c0d2-3d7a-443d-bb30-34e982c4cc31 None None] MFA Rules not processed for user `e2bee8738ab74f1e860da7fc05b64e6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:31.589570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f284c0d2-3d7a-443d-bb30-34e982c4cc31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:31.665088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1224/2465] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:31 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:31.674747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8dec-1cef-4e12-8788-1669b49da6a9 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:31.676513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-76ad8dec-1cef-4e12-8788-1669b49da6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:31.708634 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:31.734869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ad8dec-1cef-4e12-8788-1669b49da6a9 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:31.739309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e8b89-f73c-4dc4-a9d3-08155bcf7b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:31.740014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e8b89-f73c-4dc4-a9d3-08155bcf7b03 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:31.740282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e8b89-f73c-4dc4-a9d3-08155bcf7b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:31.743563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e8b89-f73c-4dc4-a9d3-08155bcf7b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:31.752403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e8b89-f73c-4dc4-a9d3-08155bcf7b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:31.754593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e8b89-f73c-4dc4-a9d3-08155bcf7b03 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:31.763465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1242/2466] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:37.741233 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284c0d2-3d7a-443d-bb30-34e982c4cc31 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:37.805688 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f284c0d2-3d7a-443d-bb30-34e982c4cc31 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:37.810166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:37.810795 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:37.811076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:37.811354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] PATH_INFO: `/v3/users/e2bee8738ab74f1e860da7fc05b64e6a` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:37.812511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2bee8738ab74f1e860da7fc05b64e6a)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:37.814419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:37.997460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2bee8738ab74f1e860da7fc05b64e6a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:38.004296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2bee8738ab74f1e860da7fc05b64e6a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:38.005624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2bee8738ab74f1e860da7fc05b64e6a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:38.006221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2bee8738ab74f1e860da7fc05b64e6a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:38.074579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2bee8738ab74f1e860da7fc05b64e6a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:38.079938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:INSERT=4,keystone:SELECT=87,keystone:DELETE=9 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:38.092642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1225/2467] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:56:37 2022] DELETE /identity/v3/users/e2bee8738ab74f1e860da7fc05b64e6a => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:38.097121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a996b9-cb8e-4348-b7df-c31baeaa0363 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:38.097641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a996b9-cb8e-4348-b7df-c31baeaa0363 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:38.097641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a996b9-cb8e-4348-b7df-c31baeaa0363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:38.116848 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c0a996b9-cb8e-4348-b7df-c31baeaa0363 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:38.118025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c0a996b9-cb8e-4348-b7df-c31baeaa0363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:38.175019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1243/2468] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:38.184924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:38.187582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:38.240921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e09fe9-1d97-4c52-b6cc-3852e23a7cd7 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:38.244542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668868a0-f6eb-481d-a824-315a685a0030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:38.245140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668868a0-f6eb-481d-a824-315a685a0030 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:38.245413 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668868a0-f6eb-481d-a824-315a685a0030 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:38.245682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668868a0-f6eb-481d-a824-315a685a0030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:38.255199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668868a0-f6eb-481d-a824-315a685a0030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:38.256581 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668868a0-f6eb-481d-a824-315a685a0030 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:38.265904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1226/2469] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:56:38.763029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a996b9-cb8e-4348-b7df-c31baeaa0363 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:38.764592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c0a996b9-cb8e-4348-b7df-c31baeaa0363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:38.777009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a996b9-cb8e-4348-b7df-c31baeaa0363 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:38.782192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:38.791126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:38.791126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:38.791126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] PATH_INFO: `/v3/projects/8564a7210b4e48c68cc664b049c00275` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:38.791126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8564a7210b4e48c68cc664b049c00275)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:38.791126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:38.915741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8564a7210b4e48c68cc664b049c00275', 'request_id': 'req-b74981cd-1642-4526-8a00-712c0ffe202f'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:38.987492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8564a7210b4e48c68cc664b049c00275', 'request_id': 'req-b74981cd-1642-4526-8a00-712c0ffe202f'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:38.994016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8564a7210b4e48c68cc664b049c00275', 'request_id': 'req-b74981cd-1642-4526-8a00-712c0ffe202f'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:39.004553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] The token cache is being invalidate because project 8564a7210b4e48c68cc664b049c00275 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:56:39.004843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:39.005512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b74981cd-1642-4526-8a00-712c0ffe202f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:56:39.007581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1244/2470] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:56:38 2022] DELETE /identity/v3/projects/8564a7210b4e48c68cc664b049c00275 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:39.012888 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261da84-2ae7-4521-8a4f-6e781dedda4f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.013342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261da84-2ae7-4521-8a4f-6e781dedda4f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.013435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4261da84-2ae7-4521-8a4f-6e781dedda4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:39.033172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-4261da84-2ae7-4521-8a4f-6e781dedda4f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:39.034412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4261da84-2ae7-4521-8a4f-6e781dedda4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:39.091899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1227/2471] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:39.156358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce298da3-22bf-404c-abb0-35f098b25e41 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.156930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce298da3-22bf-404c-abb0-35f098b25e41 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.156930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce298da3-22bf-404c-abb0-35f098b25e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:39.176439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ce298da3-22bf-404c-abb0-35f098b25e41 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:39.177640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ce298da3-22bf-404c-abb0-35f098b25e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:39.185325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1245/2472] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:39.189476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261da84-2ae7-4521-8a4f-6e781dedda4f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:39.199656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4261da84-2ae7-4521-8a4f-6e781dedda4f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:39.204270 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f9f3-45b4-4977-80d5-3f5873b4ca4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:39.204869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f9f3-45b4-4977-80d5-3f5873b4ca4a admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.205154 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f9f3-45b4-4977-80d5-3f5873b4ca4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.205428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0f9f3-45b4-4977-80d5-3f5873b4ca4a admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:39.206076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0f9f3-45b4-4977-80d5-3f5873b4ca4a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:56:39.206383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0f9f3-45b4-4977-80d5-3f5873b4ca4a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:39.208000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0f9f3-45b4-4977-80d5-3f5873b4ca4a admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:39.219783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1228/2473] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:56:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:56:39.223788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce298da3-22bf-404c-abb0-35f098b25e41 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:39.232885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce298da3-22bf-404c-abb0-35f098b25e41 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:39.237394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc5e27-3ef1-4b60-b74e-c57d7d331266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:39.237974 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc5e27-3ef1-4b60-b74e-c57d7d331266 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.238252 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc5e27-3ef1-4b60-b74e-c57d7d331266 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.238531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc5e27-3ef1-4b60-b74e-c57d7d331266 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:39.239135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc5e27-3ef1-4b60-b74e-c57d7d331266 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:39.241586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc5e27-3ef1-4b60-b74e-c57d7d331266 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:39.348580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1246/2474] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:56:39 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:56:39.349741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f9f3-45b4-4977-80d5-3f5873b4ca4a admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:39.360811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0f9f3-45b4-4977-80d5-3f5873b4ca4a admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:39.417488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0c99-d829-4c2c-9924-49fbb2044d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:39.418083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0c99-d829-4c2c-9924-49fbb2044d3d admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.418360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0c99-d829-4c2c-9924-49fbb2044d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.418629 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d0c99-d829-4c2c-9924-49fbb2044d3d admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:39.419254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0c99-d829-4c2c-9924-49fbb2044d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:39.421185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d0c99-d829-4c2c-9924-49fbb2044d3d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:39.558590 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1229/2475] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:56:39 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:56:39.560681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc5e27-3ef1-4b60-b74e-c57d7d331266 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:39.576710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc5e27-3ef1-4b60-b74e-c57d7d331266 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:39.581329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f22c0-dd02-4987-be62-47b8f40f0f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:39.582012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f22c0-dd02-4987-be62-47b8f40f0f35 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.582334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f22c0-dd02-4987-be62-47b8f40f0f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.582555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f22c0-dd02-4987-be62-47b8f40f0f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:39.583196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f22c0-dd02-4987-be62-47b8f40f0f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:39.584830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844f22c0-dd02-4987-be62-47b8f40f0f35 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:39.596576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1247/2476] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:56:39.601437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0c99-d829-4c2c-9924-49fbb2044d3d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:39.613258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d0c99-d829-4c2c-9924-49fbb2044d3d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:39.618555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ab98c5-9b2f-4427-9d50-ff693d4a08fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:39.619170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab98c5-9b2f-4427-9d50-ff693d4a08fb admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.619452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab98c5-9b2f-4427-9d50-ff693d4a08fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.619762 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ab98c5-9b2f-4427-9d50-ff693d4a08fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:39.620424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab98c5-9b2f-4427-9d50-ff693d4a08fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:39.622119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ab98c5-9b2f-4427-9d50-ff693d4a08fb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:39.624097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:39.636439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1230/2477] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:56:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:56:39.640626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f22c0-dd02-4987-be62-47b8f40f0f35 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:39.653950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f22c0-dd02-4987-be62-47b8f40f0f35 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:39.665886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d49f79-5681-497d-add2-b07461ac3d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:39.666860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d49f79-5681-497d-add2-b07461ac3d2d admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.667472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d49f79-5681-497d-add2-b07461ac3d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.668114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d49f79-5681-497d-add2-b07461ac3d2d admin admin] PATH_INFO: `/v3/projects/9c12a37350bb47aca068cb39fe807d0a/users/a9adcdf31ad04666970949db298e3aff/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:39.682560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:39.687017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d49f79-5681-497d-add2-b07461ac3d2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c12a37350bb47aca068cb39fe807d0a, user_id=a9adcdf31ad04666970949db298e3aff, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:39.689982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d49f79-5681-497d-add2-b07461ac3d2d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:39.813949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1248/2478] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:56:39 2022] PUT /identity/v3/projects/9c12a37350bb47aca068cb39fe807d0a/users/a9adcdf31ad04666970949db298e3aff/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:39.825269 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd78e87-8075-48f0-b7a5-04348516da31 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.825564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd78e87-8075-48f0-b7a5-04348516da31 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.825843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd78e87-8075-48f0-b7a5-04348516da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:39.846296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7cd78e87-8075-48f0-b7a5-04348516da31 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:39.846763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7cd78e87-8075-48f0-b7a5-04348516da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:39.910545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1231/2479] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:39.920770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d49f79-5681-497d-add2-b07461ac3d2d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:39.923634 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d9d49f79-5681-497d-add2-b07461ac3d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:39.986767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d49f79-5681-497d-add2-b07461ac3d2d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:39.992085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f832b98-e2d2-4cab-acac-068f78edb006 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:39.993083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f832b98-e2d2-4cab-acac-068f78edb006 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:39.993729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f832b98-e2d2-4cab-acac-068f78edb006 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:39.994005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f832b98-e2d2-4cab-acac-068f78edb006 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:40.007500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f832b98-e2d2-4cab-acac-068f78edb006 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:40.009298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f832b98-e2d2-4cab-acac-068f78edb006 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:40.020144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1249/2480] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:44.745964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fec208-cc79-434a-9768-8543fd6ca5da None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:44.746467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fec208-cc79-434a-9768-8543fd6ca5da None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:44.746575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fec208-cc79-434a-9768-8543fd6ca5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:44.766102 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-67fec208-cc79-434a-9768-8543fd6ca5da None None] MFA Rules not processed for user `b9aef63cad18473994760d8bbc6faae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:44.767321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-67fec208-cc79-434a-9768-8543fd6ca5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:44.823414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1232/2481] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:46.345434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad0b7-47fd-458e-aeb4-4a8c9080ae04 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:46.346416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad0b7-47fd-458e-aeb4-4a8c9080ae04 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:46.346846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ad0b7-47fd-458e-aeb4-4a8c9080ae04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:46.382415 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-6c4ad0b7-47fd-458e-aeb4-4a8c9080ae04 None None] MFA Rules not processed for user `a9adcdf31ad04666970949db298e3aff`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:46.383807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6c4ad0b7-47fd-458e-aeb4-4a8c9080ae04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:46.480786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1250/2482] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:46.482438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fec208-cc79-434a-9768-8543fd6ca5da None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:46.499881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fec208-cc79-434a-9768-8543fd6ca5da None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:46.504768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228892d7-b624-4eca-b0b9-6b0d5da1556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:46.505618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228892d7-b624-4eca-b0b9-6b0d5da1556d admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:46.505901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228892d7-b624-4eca-b0b9-6b0d5da1556d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:46.506179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228892d7-b624-4eca-b0b9-6b0d5da1556d admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:46.506911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228892d7-b624-4eca-b0b9-6b0d5da1556d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:46.508832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228892d7-b624-4eca-b0b9-6b0d5da1556d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:46.594768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1233/2483] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:56:46 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:56:46.598823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ad0b7-47fd-458e-aeb4-4a8c9080ae04 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:46.610691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ad0b7-47fd-458e-aeb4-4a8c9080ae04 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:46.684152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f22397-3750-4dcb-9507-c0e7697469ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:46.684769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f22397-3750-4dcb-9507-c0e7697469ad admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:46.685051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f22397-3750-4dcb-9507-c0e7697469ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:46.685328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f22397-3750-4dcb-9507-c0e7697469ad admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:46.685976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f22397-3750-4dcb-9507-c0e7697469ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:46.687942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f22397-3750-4dcb-9507-c0e7697469ad admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:46.796232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1251/2484] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:56:46 2022] POST /identity/v3/users => generated 298 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:56:46.800217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228892d7-b624-4eca-b0b9-6b0d5da1556d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:46.810754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228892d7-b624-4eca-b0b9-6b0d5da1556d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:46.815626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d719d-dd1d-4bb1-8d9c-088f53c5e52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:46.816232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d719d-dd1d-4bb1-8d9c-088f53c5e52a admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:46.816516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d719d-dd1d-4bb1-8d9c-088f53c5e52a admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:46.816793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d719d-dd1d-4bb1-8d9c-088f53c5e52a admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:46.817447 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d719d-dd1d-4bb1-8d9c-088f53c5e52a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:46.819714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d719d-dd1d-4bb1-8d9c-088f53c5e52a admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:46.829674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1234/2485] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:56:46.834013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f22397-3750-4dcb-9507-c0e7697469ad admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:46.843947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f22397-3750-4dcb-9507-c0e7697469ad admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:46.848751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43170a5b-96bd-49fa-b1ca-16184e8bc4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:46.849398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43170a5b-96bd-49fa-b1ca-16184e8bc4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:46.849709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43170a5b-96bd-49fa-b1ca-16184e8bc4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:46.850022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43170a5b-96bd-49fa-b1ca-16184e8bc4d5 admin admin] PATH_INFO: `/v3/projects/0a38652fd093491bb47ba9784c3ec56e/users/54e9e00188784138ab0e6bc2f99c74b9/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:46.860949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:46.868057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43170a5b-96bd-49fa-b1ca-16184e8bc4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a38652fd093491bb47ba9784c3ec56e, user_id=54e9e00188784138ab0e6bc2f99c74b9, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:46.870716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43170a5b-96bd-49fa-b1ca-16184e8bc4d5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:46.956093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1252/2486] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:56:46 2022] PUT /identity/v3/projects/0a38652fd093491bb47ba9784c3ec56e/users/54e9e00188784138ab0e6bc2f99c74b9/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:46.962106 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d719d-dd1d-4bb1-8d9c-088f53c5e52a admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:46.976002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d719d-dd1d-4bb1-8d9c-088f53c5e52a admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:47.035652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa70b02-a269-4c47-9424-089004cda25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:47.036274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa70b02-a269-4c47-9424-089004cda25b admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:47.036556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa70b02-a269-4c47-9424-089004cda25b admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:47.036836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa70b02-a269-4c47-9424-089004cda25b admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:47.037492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa70b02-a269-4c47-9424-089004cda25b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:47.039672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa70b02-a269-4c47-9424-089004cda25b admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:47.050216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1235/2487] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:56:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:56:47.054277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43170a5b-96bd-49fa-b1ca-16184e8bc4d5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:47.064748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43170a5b-96bd-49fa-b1ca-16184e8bc4d5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:47.070140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc350b-5aba-42ab-a71b-47c1f76e420f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:47.070783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc350b-5aba-42ab-a71b-47c1f76e420f admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:47.071062 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc350b-5aba-42ab-a71b-47c1f76e420f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:47.071336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc350b-5aba-42ab-a71b-47c1f76e420f admin admin] PATH_INFO: `/v3/projects/0a38652fd093491bb47ba9784c3ec56e/users/54e9e00188784138ab0e6bc2f99c74b9/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:47.073478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc350b-5aba-42ab-a71b-47c1f76e420f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a38652fd093491bb47ba9784c3ec56e, user_id=54e9e00188784138ab0e6bc2f99c74b9, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:47.076040 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc350b-5aba-42ab-a71b-47c1f76e420f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:47.087259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1253/2488] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:56:47 2022] PUT /identity/v3/projects/0a38652fd093491bb47ba9784c3ec56e/users/54e9e00188784138ab0e6bc2f99c74b9/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:56:53.936105 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062996b-b723-41a4-9d52-6749cbb0a114 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:53.936639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062996b-b723-41a4-9d52-6749cbb0a114 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:53.936639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e062996b-b723-41a4-9d52-6749cbb0a114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:53.945317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:53.990380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-e062996b-b723-41a4-9d52-6749cbb0a114 None None] MFA Rules not processed for user `54e9e00188784138ab0e6bc2f99c74b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:53.993126 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e062996b-b723-41a4-9d52-6749cbb0a114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:54.073159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1236/2489] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:56:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:54.086106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc350b-5aba-42ab-a71b-47c1f76e420f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:54.088076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-31dc350b-5aba-42ab-a71b-47c1f76e420f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:54.149350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc350b-5aba-42ab-a71b-47c1f76e420f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:54.152956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37077b-bcc1-4443-852f-6afa4b1aa495 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:54.153557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37077b-bcc1-4443-852f-6afa4b1aa495 service glance] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:54.153842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37077b-bcc1-4443-852f-6afa4b1aa495 service glance] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:54.154119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37077b-bcc1-4443-852f-6afa4b1aa495 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:54.210834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37077b-bcc1-4443-852f-6afa4b1aa495 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:54.212651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37077b-bcc1-4443-852f-6afa4b1aa495 service glance] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:54.222292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1254/2490] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:56:54.489624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3cbc2-4b00-47fb-b3fb-a7de1b299ce4 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:54.490006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3cbc2-4b00-47fb-b3fb-a7de1b299ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:54.490352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3cbc2-4b00-47fb-b3fb-a7de1b299ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:54.512252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-3ef3cbc2-4b00-47fb-b3fb-a7de1b299ce4 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:56:54.513441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3ef3cbc2-4b00-47fb-b3fb-a7de1b299ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:54.571351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1237/2491] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:56:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:56:54.786527 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37077b-bcc1-4443-852f-6afa4b1aa495 service glance] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:54.788063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8f37077b-bcc1-4443-852f-6afa4b1aa495 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:54.870637 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37077b-bcc1-4443-852f-6afa4b1aa495 service glance] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:54.875693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49507-ceb3-49d8-9c0e-3c114fe2ed75 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:54.876304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49507-ceb3-49d8-9c0e-3c114fe2ed75 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:54.876585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49507-ceb3-49d8-9c0e-3c114fe2ed75 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:54.876860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b49507-ceb3-49d8-9c0e-3c114fe2ed75 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:54.885295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b49507-ceb3-49d8-9c0e-3c114fe2ed75 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:54.886872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b49507-ceb3-49d8-9c0e-3c114fe2ed75 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:54.899908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1255/2492] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:56:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:56:56.441763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3cbc2-4b00-47fb-b3fb-a7de1b299ce4 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:56:56.445113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3ef3cbc2-4b00-47fb-b3fb-a7de1b299ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:56.604730 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3cbc2-4b00-47fb-b3fb-a7de1b299ce4 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:56:56.619324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:56:56.620041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:56:56.620323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:56:56.620603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:56:56.623345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:56:56.700218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:56:56.764490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:56:56.770302 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:56:56.789320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1238/2493] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:56:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:00.190520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49507-ceb3-49d8-9c0e-3c114fe2ed75 service swift] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:00.205358 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b49507-ceb3-49d8-9c0e-3c114fe2ed75 service swift] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:00.209708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70921-3479-4649-9c77-aedc74db1394 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4289134c7df04f96a5c4661165105109', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:00.210874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70921-3479-4649-9c77-aedc74db1394 service glance] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:00.211154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70921-3479-4649-9c77-aedc74db1394 service glance] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:00.211787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b70921-3479-4649-9c77-aedc74db1394 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:00.213756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-47b70921-3479-4649-9c77-aedc74db1394 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:00.233677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b70921-3479-4649-9c77-aedc74db1394 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:00.235182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b70921-3479-4649-9c77-aedc74db1394 service glance] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:00.249562 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1256/2494] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:00.747935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:00.750053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:00.765628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33300f63-400e-4be8-b54e-06613c21b91c service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:00.771792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf47c7-412f-401d-bbfb-7e368e207c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:00.773043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf47c7-412f-401d-bbfb-7e368e207c98 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:00.773326 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf47c7-412f-401d-bbfb-7e368e207c98 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:00.773601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedf47c7-412f-401d-bbfb-7e368e207c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:00.775359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-aedf47c7-412f-401d-bbfb-7e368e207c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:00.845103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf47c7-412f-401d-bbfb-7e368e207c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:00.847002 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedf47c7-412f-401d-bbfb-7e368e207c98 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:00.859257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1239/2495] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:00.905607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70921-3479-4649-9c77-aedc74db1394 service glance] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:00.910947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:00.969656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b70921-3479-4649-9c77-aedc74db1394 service glance] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:00.973390 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8f159-2f1c-472a-bd3f-cc1a4ff7340e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:00.974097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8f159-2f1c-472a-bd3f-cc1a4ff7340e service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:00.976694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8f159-2f1c-472a-bd3f-cc1a4ff7340e service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:00.977096 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8f159-2f1c-472a-bd3f-cc1a4ff7340e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:00.979047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d7a8f159-2f1c-472a-bd3f-cc1a4ff7340e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:01.057678 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8f159-2f1c-472a-bd3f-cc1a4ff7340e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:01.059018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8f159-2f1c-472a-bd3f-cc1a4ff7340e service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:01.073097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1257/2496] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:03.099646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf47c7-412f-401d-bbfb-7e368e207c98 service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:03.111432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedf47c7-412f-401d-bbfb-7e368e207c98 service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:03.115750 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:03.117260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:03.118353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:03.118845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:03.121123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:03.140098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:03.141869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:03.156893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1240/2497] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:04.106418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8f159-2f1c-472a-bd3f-cc1a4ff7340e service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:04.126386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8f159-2f1c-472a-bd3f-cc1a4ff7340e service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:04.143765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ce7a0-14e8-4f88-b459-9be71818e520 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:04.144479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ce7a0-14e8-4f88-b459-9be71818e520 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:04.146039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ce7a0-14e8-4f88-b459-9be71818e520 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:04.150139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ce7a0-14e8-4f88-b459-9be71818e520 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:04.153464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-062ce7a0-14e8-4f88-b459-9be71818e520 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:04.251894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ce7a0-14e8-4f88-b459-9be71818e520 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:04.254078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ce7a0-14e8-4f88-b459-9be71818e520 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:04.286947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1258/2498] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:06.132560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:06.134797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:06.152568 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2c37f-0188-4970-9a4b-edbbd429933f service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:06.158779 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:06.159760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:06.160364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:06.160724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] PATH_INFO: `/v3/users/2d5f07704f014ae7a4997fca3c2faa6c` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:06.161938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d5f07704f014ae7a4997fca3c2faa6c)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:06.164190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:06.491735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d5f07704f014ae7a4997fca3c2faa6c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:06.498837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d5f07704f014ae7a4997fca3c2faa6c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:06.502188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d5f07704f014ae7a4997fca3c2faa6c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:06.502188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d5f07704f014ae7a4997fca3c2faa6c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:06.566220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d5f07704f014ae7a4997fca3c2faa6c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:06.593319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1241/2499] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:57:06 2022] DELETE /identity/v3/users/2d5f07704f014ae7a4997fca3c2faa6c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:57:06.874998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00d86-278b-40f0-87ab-88a0a88d42aa None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:06.875484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00d86-278b-40f0-87ab-88a0a88d42aa None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:06.875596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d00d86-278b-40f0-87ab-88a0a88d42aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:06.893826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:06.895296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:06.903902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-63d00d86-278b-40f0-87ab-88a0a88d42aa None None] MFA Rules not processed for user `a9adcdf31ad04666970949db298e3aff`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:06.905125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-63d00d86-278b-40f0-87ab-88a0a88d42aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:06.940229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:06.988769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:06.999287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e789f-383d-4795-a2ae-d30ea34b3b82 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:07.000353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1259/2500] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:57:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:07.005114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:07.006011 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.006416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.006702 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] PATH_INFO: `/v3/projects/a585bde3a6734feba535505dd1aaace8` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.007972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a585bde3a6734feba535505dd1aaace8)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:07.010060 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:07.148193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a585bde3a6734feba535505dd1aaace8', 'request_id': 'req-af2c861f-c357-4cea-9b30-20c61689bdcb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:07.202175 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a585bde3a6734feba535505dd1aaace8', 'request_id': 'req-af2c861f-c357-4cea-9b30-20c61689bdcb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:07.208932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a585bde3a6734feba535505dd1aaace8', 'request_id': 'req-af2c861f-c357-4cea-9b30-20c61689bdcb'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:07.221496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] The token cache is being invalidate because project a585bde3a6734feba535505dd1aaace8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:57:07.221788 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:07.222460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-af2c861f-c357-4cea-9b30-20c61689bdcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:57:07.223985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1242/2501] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:57:06 2022] DELETE /identity/v3/projects/a585bde3a6734feba535505dd1aaace8 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:57:07.229595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9d434-6107-444b-92e3-2b8ac40bbc03 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.229905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9d434-6107-444b-92e3-2b8ac40bbc03 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.230183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f9d434-6107-444b-92e3-2b8ac40bbc03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.253463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d9f9d434-6107-444b-92e3-2b8ac40bbc03 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:07.254706 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d9f9d434-6107-444b-92e3-2b8ac40bbc03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:07.317310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1260/2502] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:57:07.325737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1021-2349-4348-8bd0-0896c34f2eed None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.326042 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1021-2349-4348-8bd0-0896c34f2eed None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.326300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57e1021-2349-4348-8bd0-0896c34f2eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.347660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b57e1021-2349-4348-8bd0-0896c34f2eed None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:07.348879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b57e1021-2349-4348-8bd0-0896c34f2eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:07.357908 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1243/2503] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:07.362171 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9d434-6107-444b-92e3-2b8ac40bbc03 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:07.372666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f9d434-6107-444b-92e3-2b8ac40bbc03 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:07.377305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33105d15-7aea-4b06-b127-d11f3628bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:07.377940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33105d15-7aea-4b06-b127-d11f3628bf66 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.378238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33105d15-7aea-4b06-b127-d11f3628bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.378494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33105d15-7aea-4b06-b127-d11f3628bf66 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.379146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33105d15-7aea-4b06-b127-d11f3628bf66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:57:07.379449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33105d15-7aea-4b06-b127-d11f3628bf66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:07.381181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33105d15-7aea-4b06-b127-d11f3628bf66 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:07.393672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1261/2504] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:57:07.398709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1021-2349-4348-8bd0-0896c34f2eed None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:07.408005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57e1021-2349-4348-8bd0-0896c34f2eed None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:07.412637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70835146-dd88-446e-a67e-335419ad5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:07.413234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835146-dd88-446e-a67e-335419ad5dfd admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.413723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835146-dd88-446e-a67e-335419ad5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.413996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70835146-dd88-446e-a67e-335419ad5dfd admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.414626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835146-dd88-446e-a67e-335419ad5dfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:07.416551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70835146-dd88-446e-a67e-335419ad5dfd admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:07.503503 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1244/2505] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:57:07 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:57:07.505025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33105d15-7aea-4b06-b127-d11f3628bf66 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:07.511985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70835146-dd88-446e-a67e-335419ad5dfd admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:07.514037 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-70835146-dd88-446e-a67e-335419ad5dfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:07.516215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33105d15-7aea-4b06-b127-d11f3628bf66 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:07.581524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70835146-dd88-446e-a67e-335419ad5dfd admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:07.584984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bca728-a3c5-4261-b653-b1a2d9a8bdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:07.585793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf66ed0-4536-496d-bc56-abc62d47f720 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:07.586160 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bca728-a3c5-4261-b653-b1a2d9a8bdf2 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.586404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf66ed0-4536-496d-bc56-abc62d47f720 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.586509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bca728-a3c5-4261-b653-b1a2d9a8bdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.586684 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf66ed0-4536-496d-bc56-abc62d47f720 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.586960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf66ed0-4536-496d-bc56-abc62d47f720 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.587319 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bca728-a3c5-4261-b653-b1a2d9a8bdf2 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.588001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bca728-a3c5-4261-b653-b1a2d9a8bdf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:07.589938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bca728-a3c5-4261-b653-b1a2d9a8bdf2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:07.593188 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-2bf66ed0-4536-496d-bc56-abc62d47f720 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:07.608333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf66ed0-4536-496d-bc56-abc62d47f720 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:07.609781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf66ed0-4536-496d-bc56-abc62d47f720 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:07.618414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1245/2506] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:07.676392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1262/2507] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:57:07 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:57:07.681142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf66ed0-4536-496d-bc56-abc62d47f720 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:07.693204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf66ed0-4536-496d-bc56-abc62d47f720 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:07.698542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30bf3e-9bdb-451a-b8fe-f85feb49d09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:07.699164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30bf3e-9bdb-451a-b8fe-f85feb49d09c admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.699462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30bf3e-9bdb-451a-b8fe-f85feb49d09c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.699778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30bf3e-9bdb-451a-b8fe-f85feb49d09c admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.700428 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30bf3e-9bdb-451a-b8fe-f85feb49d09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:07.702133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30bf3e-9bdb-451a-b8fe-f85feb49d09c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:07.715912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1246/2508] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:57:07.717239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bca728-a3c5-4261-b653-b1a2d9a8bdf2 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:07.727323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bca728-a3c5-4261-b653-b1a2d9a8bdf2 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:07.731878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9619493-9a4e-455a-9195-36cdaafa118d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:07.732740 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9619493-9a4e-455a-9195-36cdaafa118d admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.733020 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9619493-9a4e-455a-9195-36cdaafa118d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.733300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9619493-9a4e-455a-9195-36cdaafa118d admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.733950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9619493-9a4e-455a-9195-36cdaafa118d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:07.735607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9619493-9a4e-455a-9195-36cdaafa118d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:07.746630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1263/2509] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:57:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:57:07.750915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30bf3e-9bdb-451a-b8fe-f85feb49d09c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:07.761778 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30bf3e-9bdb-451a-b8fe-f85feb49d09c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:07.767032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f497a-2b3a-41ea-9421-1f61b5e79d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:07.767779 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f497a-2b3a-41ea-9421-1f61b5e79d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.768061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f497a-2b3a-41ea-9421-1f61b5e79d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.768361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f497a-2b3a-41ea-9421-1f61b5e79d1d admin admin] PATH_INFO: `/v3/projects/382dfc6c4f0948b0aa434fc7252f4e00/users/f9590b2b76244d4f8b375a1782a6b99c/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.787530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f497a-2b3a-41ea-9421-1f61b5e79d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=382dfc6c4f0948b0aa434fc7252f4e00, user_id=f9590b2b76244d4f8b375a1782a6b99c, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:07.790315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602f497a-2b3a-41ea-9421-1f61b5e79d1d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:07.859951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:07.869525 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1247/2510] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:57:07 2022] PUT /identity/v3/projects/382dfc6c4f0948b0aa434fc7252f4e00/users/f9590b2b76244d4f8b375a1782a6b99c/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:57:07.871158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e34e8e-d97d-4676-a9d7-7994f33b044c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:07.871442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e34e8e-d97d-4676-a9d7-7994f33b044c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:07.871745 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e34e8e-d97d-4676-a9d7-7994f33b044c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:07.890890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-56e34e8e-d97d-4676-a9d7-7994f33b044c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:07.892166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-56e34e8e-d97d-4676-a9d7-7994f33b044c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:07.953697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1264/2511] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:57:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:07.965474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f497a-2b3a-41ea-9421-1f61b5e79d1d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:07.965474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-602f497a-2b3a-41ea-9421-1f61b5e79d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:08.027304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602f497a-2b3a-41ea-9421-1f61b5e79d1d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:08.031174 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a15a745-ea2c-42f0-9eba-828bdb1bc495 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:08.031922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15a745-ea2c-42f0-9eba-828bdb1bc495 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:08.032273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15a745-ea2c-42f0-9eba-828bdb1bc495 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:08.032618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a15a745-ea2c-42f0-9eba-828bdb1bc495 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:08.042962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15a745-ea2c-42f0-9eba-828bdb1bc495 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:08.044539 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a15a745-ea2c-42f0-9eba-828bdb1bc495 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:08.056204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1248/2512] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:08.163956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e34e8e-d97d-4676-a9d7-7994f33b044c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:08.165849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-56e34e8e-d97d-4676-a9d7-7994f33b044c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:08.173836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:08.260093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e34e8e-d97d-4676-a9d7-7994f33b044c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:08.265403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:08.266115 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:08.266467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:08.266814 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:08.268731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:08.281174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:08.282812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:08.300774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1265/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:11.802418 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23de3-ea04-4da3-bf93-c835c62adc1c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:11.803300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23de3-ea04-4da3-bf93-c835c62adc1c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:11.804310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd23de3-ea04-4da3-bf93-c835c62adc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:11.828452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-4dd23de3-ea04-4da3-bf93-c835c62adc1c None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:11.829838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4dd23de3-ea04-4da3-bf93-c835c62adc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:11.902194 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1249/2514] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:11.916364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:11.917879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:12.019557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2bebf8-b37b-479b-b3c7-9f72caa9a1b7 service placement] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:12.029106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368461dc-8301-40f7-85ea-5a8c18b30a86 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:12.031604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368461dc-8301-40f7-85ea-5a8c18b30a86 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:12.035530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368461dc-8301-40f7-85ea-5a8c18b30a86 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:12.035530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368461dc-8301-40f7-85ea-5a8c18b30a86 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:12.043859 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368461dc-8301-40f7-85ea-5a8c18b30a86 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:12.045640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368461dc-8301-40f7-85ea-5a8c18b30a86 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:12.056454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1266/2515] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:57:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:57:13.691754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd23de3-ea04-4da3-bf93-c835c62adc1c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:13.707707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd23de3-ea04-4da3-bf93-c835c62adc1c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:13.712307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b22634-a2bd-46f3-8e16-c39244d2ab73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:13.712928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b22634-a2bd-46f3-8e16-c39244d2ab73 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:13.713205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b22634-a2bd-46f3-8e16-c39244d2ab73 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:13.713476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b22634-a2bd-46f3-8e16-c39244d2ab73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:13.715435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d9b22634-a2bd-46f3-8e16-c39244d2ab73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:13.726560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b22634-a2bd-46f3-8e16-c39244d2ab73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:13.728358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b22634-a2bd-46f3-8e16-c39244d2ab73 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:13.739083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1250/2516] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:57:15.554449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c8738-fba9-4760-94c6-6773e89749f5 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:15.555023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c8738-fba9-4760-94c6-6773e89749f5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:15.555225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c8738-fba9-4760-94c6-6773e89749f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:15.591221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-4c3c8738-fba9-4760-94c6-6773e89749f5 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:15.592493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4c3c8738-fba9-4760-94c6-6773e89749f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:15.606917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1267/2517] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:57:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:57:15.632918 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b22634-a2bd-46f3-8e16-c39244d2ab73 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:15.649755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b22634-a2bd-46f3-8e16-c39244d2ab73 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:15.656882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84f0cb-5309-4257-95c0-b5cf6db34e89 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:15.658006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84f0cb-5309-4257-95c0-b5cf6db34e89 service swift] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:15.658481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84f0cb-5309-4257-95c0-b5cf6db34e89 service swift] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:15.658755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84f0cb-5309-4257-95c0-b5cf6db34e89 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:15.672462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84f0cb-5309-4257-95c0-b5cf6db34e89 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:15.674127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e84f0cb-5309-4257-95c0-b5cf6db34e89 service swift] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:15.693384 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1251/2518] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:57:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:57:16.985629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc573f-ee61-489b-88f4-918b17a977a5 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:16.986145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc573f-ee61-489b-88f4-918b17a977a5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:16.986257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dc573f-ee61-489b-88f4-918b17a977a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:17.102694 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-89dc573f-ee61-489b-88f4-918b17a977a5 None None] MFA Rules not processed for user `f9590b2b76244d4f8b375a1782a6b99c`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:17.104068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-89dc573f-ee61-489b-88f4-918b17a977a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:17.222889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1268/2519] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:57:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:17.242143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84f0cb-5309-4257-95c0-b5cf6db34e89 service swift] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:17.243584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5e84f0cb-5309-4257-95c0-b5cf6db34e89 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:17.433621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84f0cb-5309-4257-95c0-b5cf6db34e89 service swift] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:17.451774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c3b2a-ccee-4d2e-934b-b2785dc38710 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:17.451774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c3b2a-ccee-4d2e-934b-b2785dc38710 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:17.451774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c3b2a-ccee-4d2e-934b-b2785dc38710 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:17.451774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8c3b2a-ccee-4d2e-934b-b2785dc38710 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:17.485648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c3b2a-ccee-4d2e-934b-b2785dc38710 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:17.488181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8c3b2a-ccee-4d2e-934b-b2785dc38710 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:17.517804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1252/2520] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:22.032450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f305-b55f-4920-8b2e-6e44fbc6244b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:22.032450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f305-b55f-4920-8b2e-6e44fbc6244b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:22.032450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f3f305-b55f-4920-8b2e-6e44fbc6244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:22.060013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:22.090318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b7f3f305-b55f-4920-8b2e-6e44fbc6244b None None] MFA Rules not processed for user `f9590b2b76244d4f8b375a1782a6b99c`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:22.094333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b7f3f305-b55f-4920-8b2e-6e44fbc6244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:22.120274 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1269/2521] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:57:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:24.655564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c3b2a-ccee-4d2e-934b-b2785dc38710 service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:24.661544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:24.665735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8c3b2a-ccee-4d2e-934b-b2785dc38710 service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:24.669379 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36ded1-9f3b-4a13-bc0f-eced02f8e41b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:24.669972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ded1-9f3b-4a13-bc0f-eced02f8e41b service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:24.670248 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ded1-9f3b-4a13-bc0f-eced02f8e41b service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:24.670542 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36ded1-9f3b-4a13-bc0f-eced02f8e41b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:24.672334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1f36ded1-9f3b-4a13-bc0f-eced02f8e41b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:24.682461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36ded1-9f3b-4a13-bc0f-eced02f8e41b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:24.683937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f36ded1-9f3b-4a13-bc0f-eced02f8e41b service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:24.692319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1253/2522] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:30.099007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3f305-b55f-4920-8b2e-6e44fbc6244b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:30.100505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b7f3f305-b55f-4920-8b2e-6e44fbc6244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:30.117006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f3f305-b55f-4920-8b2e-6e44fbc6244b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:30.123323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6131de-b718-4579-a526-f5aa67d1ebd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:30.123587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6131de-b718-4579-a526-f5aa67d1ebd3 service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:30.123869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6131de-b718-4579-a526-f5aa67d1ebd3 service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:30.124140 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6131de-b718-4579-a526-f5aa67d1ebd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:30.125838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-de6131de-b718-4579-a526-f5aa67d1ebd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:30.150878 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6131de-b718-4579-a526-f5aa67d1ebd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:30.152537 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6131de-b718-4579-a526-f5aa67d1ebd3 service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:30.164969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1270/2523] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:34.700200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:38.257039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36ded1-9f3b-4a13-bc0f-eced02f8e41b service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:38.271630 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36ded1-9f3b-4a13-bc0f-eced02f8e41b service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:38.282658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287768a9-b058-4fe1-b25d-67f90a11b929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:38.282658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287768a9-b058-4fe1-b25d-67f90a11b929 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:38.282658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287768a9-b058-4fe1-b25d-67f90a11b929 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:38.282658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287768a9-b058-4fe1-b25d-67f90a11b929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:38.282991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-287768a9-b058-4fe1-b25d-67f90a11b929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:38.293550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287768a9-b058-4fe1-b25d-67f90a11b929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:38.295170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287768a9-b058-4fe1-b25d-67f90a11b929 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:38.307412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1254/2524] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:40.159158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=6 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:41.150559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4379a6-ef4f-4dda-9d68-3164710c2e48 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:41.150842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4379a6-ef4f-4dda-9d68-3164710c2e48 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:41.151116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4379a6-ef4f-4dda-9d68-3164710c2e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:41.170862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-dd4379a6-ef4f-4dda-9d68-3164710c2e48 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:41.172114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-dd4379a6-ef4f-4dda-9d68-3164710c2e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:41.179517 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1271/2525] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:57:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:41.191978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287768a9-b058-4fe1-b25d-67f90a11b929 service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:41.203871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287768a9-b058-4fe1-b25d-67f90a11b929 service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:41.210015 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e219f0-1df3-460b-89b0-96d1e1a3bdf0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:41.210613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e219f0-1df3-460b-89b0-96d1e1a3bdf0 service swift] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:41.210897 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e219f0-1df3-460b-89b0-96d1e1a3bdf0 service swift] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:41.211173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e219f0-1df3-460b-89b0-96d1e1a3bdf0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:41.221199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e219f0-1df3-460b-89b0-96d1e1a3bdf0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:41.222780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e219f0-1df3-460b-89b0-96d1e1a3bdf0 service swift] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:41.231892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1255/2526] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:57:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:57:41.993520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4379a6-ef4f-4dda-9d68-3164710c2e48 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:42.009448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4379a6-ef4f-4dda-9d68-3164710c2e48 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:42.021902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411006bf-2ec2-44ce-8edf-83f727deac99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:42.022525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411006bf-2ec2-44ce-8edf-83f727deac99 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:42.022808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411006bf-2ec2-44ce-8edf-83f727deac99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:42.023081 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411006bf-2ec2-44ce-8edf-83f727deac99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:42.025459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-411006bf-2ec2-44ce-8edf-83f727deac99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:42.147203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411006bf-2ec2-44ce-8edf-83f727deac99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:42.149320 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411006bf-2ec2-44ce-8edf-83f727deac99 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:42.179165 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1272/2527] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:41 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:44.870254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e219f0-1df3-460b-89b0-96d1e1a3bdf0 service swift] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:44.885603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e219f0-1df3-460b-89b0-96d1e1a3bdf0 service swift] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:44.894069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b952dd0-d384-47ab-a313-55f620cb0ed2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:44.894959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b952dd0-d384-47ab-a313-55f620cb0ed2 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:44.895242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b952dd0-d384-47ab-a313-55f620cb0ed2 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:44.895776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b952dd0-d384-47ab-a313-55f620cb0ed2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:44.897845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9b952dd0-d384-47ab-a313-55f620cb0ed2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:44.912959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b952dd0-d384-47ab-a313-55f620cb0ed2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:44.915273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b952dd0-d384-47ab-a313-55f620cb0ed2 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:44.938426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1256/2528] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:57:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:57:52.170737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=33 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:54.922200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=18 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:57:59.471150 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f7336-4b73-48dd-a5b9-19f6a716aa36 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:59.471668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f7336-4b73-48dd-a5b9-19f6a716aa36 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:59.471779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f7336-4b73-48dd-a5b9-19f6a716aa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:59.491359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-021f7336-4b73-48dd-a5b9-19f6a716aa36 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:57:59.492592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-021f7336-4b73-48dd-a5b9-19f6a716aa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:57:59.499727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1273/2529] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 08:57:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:57:59.523355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b952dd0-d384-47ab-a313-55f620cb0ed2 service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:57:59.534412 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b952dd0-d384-47ab-a313-55f620cb0ed2 service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:57:59.539531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9666a135-b3f4-41d3-a6a8-0cfa63aa0a12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:57:59.540142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666a135-b3f4-41d3-a6a8-0cfa63aa0a12 service swift] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:57:59.540423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666a135-b3f4-41d3-a6a8-0cfa63aa0a12 service swift] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:57:59.540699 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9666a135-b3f4-41d3-a6a8-0cfa63aa0a12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:57:59.548906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666a135-b3f4-41d3-a6a8-0cfa63aa0a12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:57:59.550476 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9666a135-b3f4-41d3-a6a8-0cfa63aa0a12 service swift] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:57:59.558658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1257/2530] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:57:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:58:06.004771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f7336-4b73-48dd-a5b9-19f6a716aa36 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:06.014009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021f7336-4b73-48dd-a5b9-19f6a716aa36 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:06.017668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd8ac2d-bfc1-4d04-a785-47d37bf00a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:06.018283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ac2d-bfc1-4d04-a785-47d37bf00a50 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:06.018569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ac2d-bfc1-4d04-a785-47d37bf00a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:06.018846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd8ac2d-bfc1-4d04-a785-47d37bf00a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:06.020573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2fd8ac2d-bfc1-4d04-a785-47d37bf00a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:06.032291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8ac2d-bfc1-4d04-a785-47d37bf00a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:06.033715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd8ac2d-bfc1-4d04-a785-47d37bf00a50 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:06.043181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1274/2531] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:09.555315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=6 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:09.557286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645485-8f5d-4c15-a59a-10e835408234 None None] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:09.557736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645485-8f5d-4c15-a59a-10e835408234 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:09.558018 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3645485-8f5d-4c15-a59a-10e835408234 None None] PATH_INFO: `/` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:09.559388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1258/2532] 10.222.0.25 () {54 vars in 961 bytes} [Tue Oct 4 08:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 04 08:58:09.565969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237b1a-c17b-4e13-953d-9d9085fb1202 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:09.566434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237b1a-c17b-4e13-953d-9d9085fb1202 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:09.566560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237b1a-c17b-4e13-953d-9d9085fb1202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:09.588065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-c3237b1a-c17b-4e13-953d-9d9085fb1202 None None] MFA Rules not processed for user `22aa2b6e4b854de4868b75cc9626b8e5`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:09.589421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c3237b1a-c17b-4e13-953d-9d9085fb1202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:09.598943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1275/2533] 10.222.0.25 () {58 vars in 1058 bytes} [Tue Oct 4 08:58:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:09.607093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3645485-8f5d-4c15-a59a-10e835408234 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:09.621184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3645485-8f5d-4c15-a59a-10e835408234 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:09.626219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16f074-6d76-4a36-9192-9744dab9665c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:09.626836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16f074-6d76-4a36-9192-9744dab9665c service placement] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:09.627115 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16f074-6d76-4a36-9192-9744dab9665c service placement] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:09.628167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16f074-6d76-4a36-9192-9744dab9665c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:09.629981 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1f16f074-6d76-4a36-9192-9744dab9665c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:09.641169 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16f074-6d76-4a36-9192-9744dab9665c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:09.642723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16f074-6d76-4a36-9192-9744dab9665c service placement] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:09.652755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1259/2534] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:09.730082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3237b1a-c17b-4e13-953d-9d9085fb1202 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:09.730082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c3237b1a-c17b-4e13-953d-9d9085fb1202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:09.740244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3237b1a-c17b-4e13-953d-9d9085fb1202 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:09.744940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:09.745569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:09.745850 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:09.746125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] PATH_INFO: `/v3/users/b9aef63cad18473994760d8bbc6faae0` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:09.747248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9aef63cad18473994760d8bbc6faae0)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:09.749217 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:10.044172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9aef63cad18473994760d8bbc6faae0'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.051646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9aef63cad18473994760d8bbc6faae0'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.052295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9aef63cad18473994760d8bbc6faae0'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.052910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9aef63cad18473994760d8bbc6faae0'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.132334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b78e9618-db1a-4182-bccc-c9a89e0958ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9aef63cad18473994760d8bbc6faae0'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.150114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1276/2535] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:09 2022] DELETE /identity/v3/users/b9aef63cad18473994760d8bbc6faae0 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:10.471949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16f074-6d76-4a36-9192-9744dab9665c service placement] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:10.483313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16f074-6d76-4a36-9192-9744dab9665c service placement] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:10.543668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:10.544239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:10.544524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:10.544807 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] PATH_INFO: `/v3/projects/39d9561f5e5147c683280e844dc1d42c` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:10.545915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d9561f5e5147c683280e844dc1d42c)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:10.547871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:10.663263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d9561f5e5147c683280e844dc1d42c', 'request_id': 'req-9c14d616-821c-4c16-be59-5d9d4c2117d8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.771205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d9561f5e5147c683280e844dc1d42c', 'request_id': 'req-9c14d616-821c-4c16-be59-5d9d4c2117d8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.778179 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d9561f5e5147c683280e844dc1d42c', 'request_id': 'req-9c14d616-821c-4c16-be59-5d9d4c2117d8'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.788438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] The token cache is being invalidate because project 39d9561f5e5147c683280e844dc1d42c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:10.788725 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.789339 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9c14d616-821c-4c16-be59-5d9d4c2117d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:10.790801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1260/2536] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:10 2022] DELETE /identity/v3/projects/39d9561f5e5147c683280e844dc1d42c => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:10.795943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d90d1-b67e-44ce-be66-94808aae6209 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:10.796412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d90d1-b67e-44ce-be66-94808aae6209 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:10.796412 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d90d1-b67e-44ce-be66-94808aae6209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:10.817162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f26d90d1-b67e-44ce-be66-94808aae6209 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:10.818422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f26d90d1-b67e-44ce-be66-94808aae6209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:10.876325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1277/2537] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:10.884972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd71da-9052-4330-9189-66f175b107d5 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:10.885256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd71da-9052-4330-9189-66f175b107d5 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:10.885531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fd71da-9052-4330-9189-66f175b107d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:10.905406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-21fd71da-9052-4330-9189-66f175b107d5 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:10.906628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-21fd71da-9052-4330-9189-66f175b107d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:10.914396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1261/2538] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:10.918700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d90d1-b67e-44ce-be66-94808aae6209 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:10.928379 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d90d1-b67e-44ce-be66-94808aae6209 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:10.932889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779e4d-970b-4e61-bafe-30a31861baa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:10.933483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779e4d-970b-4e61-bafe-30a31861baa3 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:10.933764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779e4d-970b-4e61-bafe-30a31861baa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:10.934038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d779e4d-970b-4e61-bafe-30a31861baa3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:10.934682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d779e4d-970b-4e61-bafe-30a31861baa3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:58:10.934986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d779e4d-970b-4e61-bafe-30a31861baa3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:10.936612 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d779e4d-970b-4e61-bafe-30a31861baa3 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:10.948194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1278/2539] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:58:10.952176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd71da-9052-4330-9189-66f175b107d5 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:10.961664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fd71da-9052-4330-9189-66f175b107d5 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:10.966427 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0638c-0685-4986-a533-1ada6b17d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:10.967029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0638c-0685-4986-a533-1ada6b17d491 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:10.967314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0638c-0685-4986-a533-1ada6b17d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:10.967627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf0638c-0685-4986-a533-1ada6b17d491 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:10.968260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0638c-0685-4986-a533-1ada6b17d491 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:10.970152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf0638c-0685-4986-a533-1ada6b17d491 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:11.088679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1262/2540] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:58:10 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:11.093269 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779e4d-970b-4e61-bafe-30a31861baa3 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:11.103138 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d779e4d-970b-4e61-bafe-30a31861baa3 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:11.132841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:11.157827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133ff69-d79f-4dec-aa9d-8019e4bb7e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:11.158426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133ff69-d79f-4dec-aa9d-8019e4bb7e0d admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:11.158708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133ff69-d79f-4dec-aa9d-8019e4bb7e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:11.158983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1133ff69-d79f-4dec-aa9d-8019e4bb7e0d admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:11.159641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133ff69-d79f-4dec-aa9d-8019e4bb7e0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:11.161550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1133ff69-d79f-4dec-aa9d-8019e4bb7e0d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:11.309607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1279/2541] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:58:11 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:11.313882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0638c-0685-4986-a533-1ada6b17d491 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:11.324567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf0638c-0685-4986-a533-1ada6b17d491 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:11.330133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2a4a7-71b6-4fc4-83b6-aa3fd6419e57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:11.330133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2a4a7-71b6-4fc4-83b6-aa3fd6419e57 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:11.330133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2a4a7-71b6-4fc4-83b6-aa3fd6419e57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:11.330427 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2a4a7-71b6-4fc4-83b6-aa3fd6419e57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:11.331195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2a4a7-71b6-4fc4-83b6-aa3fd6419e57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:11.332550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2a4a7-71b6-4fc4-83b6-aa3fd6419e57 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:11.342429 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1263/2542] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:11.346338 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133ff69-d79f-4dec-aa9d-8019e4bb7e0d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:11.356500 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1133ff69-d79f-4dec-aa9d-8019e4bb7e0d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:11.361054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1f399-442c-480b-9742-777458988c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:11.362128 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1f399-442c-480b-9742-777458988c36 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:11.362405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1f399-442c-480b-9742-777458988c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:11.362666 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1f399-442c-480b-9742-777458988c36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:11.363329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1f399-442c-480b-9742-777458988c36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:11.364963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1f399-442c-480b-9742-777458988c36 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:11.374388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1280/2543] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:11.378993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2a4a7-71b6-4fc4-83b6-aa3fd6419e57 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:11.388934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2a4a7-71b6-4fc4-83b6-aa3fd6419e57 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:11.393509 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354b997-701a-47ce-8805-9edff3858b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:11.394164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354b997-701a-47ce-8805-9edff3858b71 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:11.394436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354b997-701a-47ce-8805-9edff3858b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:11.394709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354b997-701a-47ce-8805-9edff3858b71 admin admin] PATH_INFO: `/v3/projects/347cf562f7cf436080fd37c88e971488/users/8b99d4fe700045d98d18ac6f316261ab/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:11.414278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354b997-701a-47ce-8805-9edff3858b71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=347cf562f7cf436080fd37c88e971488, user_id=8b99d4fe700045d98d18ac6f316261ab, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:11.414278 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354b997-701a-47ce-8805-9edff3858b71 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:11.498067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1264/2544] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:11 2022] PUT /identity/v3/projects/347cf562f7cf436080fd37c88e971488/users/8b99d4fe700045d98d18ac6f316261ab/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:58:11.508207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ae427-1483-44c0-98e7-5afade1def68 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:11.508495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ae427-1483-44c0-98e7-5afade1def68 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:11.508770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874ae427-1483-44c0-98e7-5afade1def68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:11.535954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-874ae427-1483-44c0-98e7-5afade1def68 None None] MFA Rules not processed for user `8b99d4fe700045d98d18ac6f316261ab`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:11.537193 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-874ae427-1483-44c0-98e7-5afade1def68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:11.599284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1281/2545] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:11.604058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354b997-701a-47ce-8805-9edff3858b71 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:11.617585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:11.665214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354b997-701a-47ce-8805-9edff3858b71 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:11.669957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5000a84-226a-4549-81a3-1b5a4ee110b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:11.672574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5000a84-226a-4549-81a3-1b5a4ee110b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:11.672574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5000a84-226a-4549-81a3-1b5a4ee110b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:11.672574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5000a84-226a-4549-81a3-1b5a4ee110b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:11.672574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5000a84-226a-4549-81a3-1b5a4ee110b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:11.674304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5000a84-226a-4549-81a3-1b5a4ee110b0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:11.791773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1265/2546] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:58:11 2022] POST /identity/v3/projects => generated 385 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:11.795821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ae427-1483-44c0-98e7-5afade1def68 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:11.806927 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874ae427-1483-44c0-98e7-5afade1def68 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:11.862641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88826e-db51-4bb8-9e3e-4bf50538b493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:11.863197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88826e-db51-4bb8-9e3e-4bf50538b493 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:11.863484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88826e-db51-4bb8-9e3e-4bf50538b493 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:11.863796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec88826e-db51-4bb8-9e3e-4bf50538b493 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:11.864426 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88826e-db51-4bb8-9e3e-4bf50538b493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:11.866341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec88826e-db51-4bb8-9e3e-4bf50538b493 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:11.949393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1282/2547] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:58:11 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:11.953456 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5000a84-226a-4549-81a3-1b5a4ee110b0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:11.964496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5000a84-226a-4549-81a3-1b5a4ee110b0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:11.969313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed1559-e613-4f0c-9b8a-f795e9108b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:11.969914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed1559-e613-4f0c-9b8a-f795e9108b3b admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:11.970198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed1559-e613-4f0c-9b8a-f795e9108b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:11.971096 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ed1559-e613-4f0c-9b8a-f795e9108b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:11.971783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed1559-e613-4f0c-9b8a-f795e9108b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:11.973396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ed1559-e613-4f0c-9b8a-f795e9108b3b admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:11.984574 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1266/2548] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:11.988669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88826e-db51-4bb8-9e3e-4bf50538b493 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:11.998585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec88826e-db51-4bb8-9e3e-4bf50538b493 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:12.003236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0c6d-f4c3-4f33-8a57-9a0e90d09c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:12.003905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0c6d-f4c3-4f33-8a57-9a0e90d09c3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:12.004191 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0c6d-f4c3-4f33-8a57-9a0e90d09c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:12.004470 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b0c6d-f4c3-4f33-8a57-9a0e90d09c3c admin admin] PATH_INFO: `/v3/projects/f5ef9b70f06c4a94a05aa25544435b52/users/d4e8094222d743c1b6cfe969a1609a0c/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:12.020714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b0c6d-f4c3-4f33-8a57-9a0e90d09c3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ef9b70f06c4a94a05aa25544435b52, user_id=d4e8094222d743c1b6cfe969a1609a0c, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:12.023318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832b0c6d-f4c3-4f33-8a57-9a0e90d09c3c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:12.091969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1283/2549] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:11 2022] PUT /identity/v3/projects/f5ef9b70f06c4a94a05aa25544435b52/users/d4e8094222d743c1b6cfe969a1609a0c/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:12.096634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed1559-e613-4f0c-9b8a-f795e9108b3b admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:12.106739 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ed1559-e613-4f0c-9b8a-f795e9108b3b admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:12.163833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc46095-8dcc-4528-8092-9a1a6a42378e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:12.164365 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc46095-8dcc-4528-8092-9a1a6a42378e admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:12.164646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc46095-8dcc-4528-8092-9a1a6a42378e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:12.164919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc46095-8dcc-4528-8092-9a1a6a42378e admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:12.165561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc46095-8dcc-4528-8092-9a1a6a42378e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:12.167132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc46095-8dcc-4528-8092-9a1a6a42378e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:12.176941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1267/2550] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:58:12.181205 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0c6d-f4c3-4f33-8a57-9a0e90d09c3c admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:12.191838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832b0c6d-f4c3-4f33-8a57-9a0e90d09c3c admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:12.196385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fcd8f-04f6-44ae-8238-3fd14da173ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:12.197025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fcd8f-04f6-44ae-8238-3fd14da173ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:12.197309 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fcd8f-04f6-44ae-8238-3fd14da173ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:12.197584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fcd8f-04f6-44ae-8238-3fd14da173ae admin admin] PATH_INFO: `/v3/projects/f5ef9b70f06c4a94a05aa25544435b52/users/d4e8094222d743c1b6cfe969a1609a0c/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:12.199497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fcd8f-04f6-44ae-8238-3fd14da173ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ef9b70f06c4a94a05aa25544435b52, user_id=d4e8094222d743c1b6cfe969a1609a0c, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:12.202143 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fcd8f-04f6-44ae-8238-3fd14da173ae admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:12.204299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:12.213229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1284/2551] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:12 2022] PUT /identity/v3/projects/f5ef9b70f06c4a94a05aa25544435b52/users/d4e8094222d743c1b6cfe969a1609a0c/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:12.226044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5170a9f-63cc-483b-a21a-b5d01d5e0117 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:12.226327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5170a9f-63cc-483b-a21a-b5d01d5e0117 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:12.226598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5170a9f-63cc-483b-a21a-b5d01d5e0117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:12.254736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b5170a9f-63cc-483b-a21a-b5d01d5e0117 None None] MFA Rules not processed for user `d4e8094222d743c1b6cfe969a1609a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:12.256035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b5170a9f-63cc-483b-a21a-b5d01d5e0117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:12.322295 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1268/2552] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:12.334015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fcd8f-04f6-44ae-8238-3fd14da173ae admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:12.335723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-188fcd8f-04f6-44ae-8238-3fd14da173ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:12.390883 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fcd8f-04f6-44ae-8238-3fd14da173ae admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:12.395174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ddeb58-ad25-4264-9de0-cc910510d6d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:12.395800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddeb58-ad25-4264-9de0-cc910510d6d9 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:12.396082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddeb58-ad25-4264-9de0-cc910510d6d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:12.396351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ddeb58-ad25-4264-9de0-cc910510d6d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:12.405161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddeb58-ad25-4264-9de0-cc910510d6d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:12.406583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ddeb58-ad25-4264-9de0-cc910510d6d9 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:12.415875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1285/2553] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:12.444576 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5170a9f-63cc-483b-a21a-b5d01d5e0117 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:12.455608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:12.509374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5170a9f-63cc-483b-a21a-b5d01d5e0117 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:12.514372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:12.515092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:12.515560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:12.515850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] PATH_INFO: `/v3/users/8b99d4fe700045d98d18ac6f316261ab` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:12.517935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b99d4fe700045d98d18ac6f316261ab)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:12.519954 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:12.712177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b99d4fe700045d98d18ac6f316261ab'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:12.719103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b99d4fe700045d98d18ac6f316261ab'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:12.719892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b99d4fe700045d98d18ac6f316261ab'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:12.720534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b99d4fe700045d98d18ac6f316261ab'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:12.890816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b99d4fe700045d98d18ac6f316261ab'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:12.909176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1269/2554] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:12 2022] DELETE /identity/v3/users/8b99d4fe700045d98d18ac6f316261ab => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:12.913697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6195ac-f9b6-4c19-9d97-cc3898788c5b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:12.914154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6195ac-f9b6-4c19-9d97-cc3898788c5b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:12.914271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6195ac-f9b6-4c19-9d97-cc3898788c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:12.933135 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-fa6195ac-f9b6-4c19-9d97-cc3898788c5b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:12.934324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fa6195ac-f9b6-4c19-9d97-cc3898788c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:12.990718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1286/2555] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:13.000156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:13.001535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:13.057797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d089c230-0e88-46d0-aff5-49ed2a5893f5 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:13.061376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852816bf-fea2-4514-8d30-bf27399bca2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:13.061974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852816bf-fea2-4514-8d30-bf27399bca2a service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:13.062251 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852816bf-fea2-4514-8d30-bf27399bca2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:13.062524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852816bf-fea2-4514-8d30-bf27399bca2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:13.071222 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852816bf-fea2-4514-8d30-bf27399bca2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:13.072662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852816bf-fea2-4514-8d30-bf27399bca2a service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:13.081779 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1270/2556] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:13.550543 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6195ac-f9b6-4c19-9d97-cc3898788c5b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:13.552022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fa6195ac-f9b6-4c19-9d97-cc3898788c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:13.564010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6195ac-f9b6-4c19-9d97-cc3898788c5b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:13.568796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:13.569342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:13.569622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:13.569897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] PATH_INFO: `/v3/projects/347cf562f7cf436080fd37c88e971488` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:13.571017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=347cf562f7cf436080fd37c88e971488)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:13.572980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:13.698297 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '347cf562f7cf436080fd37c88e971488', 'request_id': 'req-4d508651-338c-41d9-99cf-101edb1841b5'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:13.840361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '347cf562f7cf436080fd37c88e971488', 'request_id': 'req-4d508651-338c-41d9-99cf-101edb1841b5'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:13.847164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '347cf562f7cf436080fd37c88e971488', 'request_id': 'req-4d508651-338c-41d9-99cf-101edb1841b5'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:13.857907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] The token cache is being invalidate because project 347cf562f7cf436080fd37c88e971488 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:13.858197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:13.858822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:13.860318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1287/2557] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:13 2022] DELETE /identity/v3/projects/347cf562f7cf436080fd37c88e971488 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:13.864320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852816bf-fea2-4514-8d30-bf27399bca2a service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:13.873919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852816bf-fea2-4514-8d30-bf27399bca2a service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:13.902746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:13.928780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:13.929402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:13.929684 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:13.929960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] PATH_INFO: `/v3/users/d4e8094222d743c1b6cfe969a1609a0c` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:13.931084 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4e8094222d743c1b6cfe969a1609a0c)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:13.933021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:14.156892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4e8094222d743c1b6cfe969a1609a0c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:14.163814 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4e8094222d743c1b6cfe969a1609a0c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:14.164498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4e8094222d743c1b6cfe969a1609a0c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:14.165163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4e8094222d743c1b6cfe969a1609a0c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:14.250229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-ea2a7a04-6c09-460d-80b2-f590f9b585e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4e8094222d743c1b6cfe969a1609a0c'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:14.268906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1271/2558] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:13 2022] DELETE /identity/v3/users/d4e8094222d743c1b6cfe969a1609a0c => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:14.717108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:14.718605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:14.747466 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d508651-338c-41d9-99cf-101edb1841b5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:14.756783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:14.796041 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:14.796670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:14.796956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:14.797233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] PATH_INFO: `/v3/projects/f5ef9b70f06c4a94a05aa25544435b52` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:14.798432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ef9b70f06c4a94a05aa25544435b52)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:14.800404 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:14.904188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ef9b70f06c4a94a05aa25544435b52', 'request_id': 'req-56e121fd-f52b-4cb0-a771-1c3185765573'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:15.024268 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ef9b70f06c4a94a05aa25544435b52', 'request_id': 'req-56e121fd-f52b-4cb0-a771-1c3185765573'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:15.031638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ef9b70f06c4a94a05aa25544435b52', 'request_id': 'req-56e121fd-f52b-4cb0-a771-1c3185765573'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:15.043056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] The token cache is being invalidate because project f5ef9b70f06c4a94a05aa25544435b52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:15.043352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:15.044029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-56e121fd-f52b-4cb0-a771-1c3185765573 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:15.045570 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1288/2559] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:14 2022] DELETE /identity/v3/projects/f5ef9b70f06c4a94a05aa25544435b52 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:15.051184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ef0a-0c9a-483b-b621-7b960dc948b2 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.051673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ef0a-0c9a-483b-b621-7b960dc948b2 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.051783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c780ef0a-0c9a-483b-b621-7b960dc948b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.071991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-c780ef0a-0c9a-483b-b621-7b960dc948b2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:15.073209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c780ef0a-0c9a-483b-b621-7b960dc948b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:15.133062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1272/2560] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:15.140835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b224-f001-476d-8d3c-26906dda978c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.141125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b224-f001-476d-8d3c-26906dda978c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.141405 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0b224-f001-476d-8d3c-26906dda978c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.161555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ddd0b224-f001-476d-8d3c-26906dda978c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:15.166230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ddd0b224-f001-476d-8d3c-26906dda978c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:15.170723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1289/2561] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:15.174801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780ef0a-0c9a-483b-b621-7b960dc948b2 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:15.184588 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c780ef0a-0c9a-483b-b621-7b960dc948b2 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:15.189234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a5c5-77aa-4eef-b396-64fcd3149286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:15.189841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a5c5-77aa-4eef-b396-64fcd3149286 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.190121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a5c5-77aa-4eef-b396-64fcd3149286 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.190397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f8a5c5-77aa-4eef-b396-64fcd3149286 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.191045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a5c5-77aa-4eef-b396-64fcd3149286 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:58:15.191352 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a5c5-77aa-4eef-b396-64fcd3149286 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:15.193479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f8a5c5-77aa-4eef-b396-64fcd3149286 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:15.205043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1273/2562] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:58:15.209933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b224-f001-476d-8d3c-26906dda978c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:15.219005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0b224-f001-476d-8d3c-26906dda978c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:15.223641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae30e-c287-4dfc-b0f9-c9109afc651b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:15.224232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae30e-c287-4dfc-b0f9-c9109afc651b admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.224513 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae30e-c287-4dfc-b0f9-c9109afc651b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.224784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ae30e-c287-4dfc-b0f9-c9109afc651b admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.225418 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ae30e-c287-4dfc-b0f9-c9109afc651b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:15.227643 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ae30e-c287-4dfc-b0f9-c9109afc651b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:15.330647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1290/2563] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:58:15 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:58:15.332264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a5c5-77aa-4eef-b396-64fcd3149286 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:15.342797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f8a5c5-77aa-4eef-b396-64fcd3149286 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:15.376597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:15.401327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c4768-6f8f-497d-8dd1-d3d65044dbed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:15.401941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c4768-6f8f-497d-8dd1-d3d65044dbed admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.402224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c4768-6f8f-497d-8dd1-d3d65044dbed admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.402499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c4768-6f8f-497d-8dd1-d3d65044dbed admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.403149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c4768-6f8f-497d-8dd1-d3d65044dbed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:15.405119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c4768-6f8f-497d-8dd1-d3d65044dbed admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:15.555633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1274/2564] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:58:15 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:58:15.559743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae30e-c287-4dfc-b0f9-c9109afc651b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:15.571664 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ae30e-c287-4dfc-b0f9-c9109afc651b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:15.576438 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b558-992d-44cf-9614-f8a32e8ece04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:15.577100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b558-992d-44cf-9614-f8a32e8ece04 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.577386 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b558-992d-44cf-9614-f8a32e8ece04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.577659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f28b558-992d-44cf-9614-f8a32e8ece04 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.578308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28b558-992d-44cf-9614-f8a32e8ece04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:15.579928 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f28b558-992d-44cf-9614-f8a32e8ece04 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:15.590345 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1291/2565] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:58:15.594463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c4768-6f8f-497d-8dd1-d3d65044dbed admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:15.604883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c4768-6f8f-497d-8dd1-d3d65044dbed admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:15.610875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c2fd87-a29c-4278-98a8-219a2dbf61b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:15.611475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2fd87-a29c-4278-98a8-219a2dbf61b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.611786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2fd87-a29c-4278-98a8-219a2dbf61b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.612062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c2fd87-a29c-4278-98a8-219a2dbf61b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.612714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2fd87-a29c-4278-98a8-219a2dbf61b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:15.614823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c2fd87-a29c-4278-98a8-219a2dbf61b7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:15.624938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1275/2566] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:15.629091 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b558-992d-44cf-9614-f8a32e8ece04 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:15.639599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f28b558-992d-44cf-9614-f8a32e8ece04 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:15.644118 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b908f1-00ec-47c1-8f06-f52cc280458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:15.644787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b908f1-00ec-47c1-8f06-f52cc280458d admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.645067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b908f1-00ec-47c1-8f06-f52cc280458d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.645344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b908f1-00ec-47c1-8f06-f52cc280458d admin admin] PATH_INFO: `/v3/projects/7c41c14f1bb6448f8acf2511915ad33f/users/f67789ef812d4147b23730170028171b/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.660006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b908f1-00ec-47c1-8f06-f52cc280458d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c41c14f1bb6448f8acf2511915ad33f, user_id=f67789ef812d4147b23730170028171b, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:15.662563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b908f1-00ec-47c1-8f06-f52cc280458d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:15.772185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1292/2567] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:15 2022] PUT /identity/v3/projects/7c41c14f1bb6448f8acf2511915ad33f/users/f67789ef812d4147b23730170028171b/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:15.782402 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59ff4-18a5-4fb5-8b9b-1a06f0be15ae None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.782684 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59ff4-18a5-4fb5-8b9b-1a06f0be15ae None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.782959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59ff4-18a5-4fb5-8b9b-1a06f0be15ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.811032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-cea59ff4-18a5-4fb5-8b9b-1a06f0be15ae None None] MFA Rules not processed for user `f67789ef812d4147b23730170028171b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:15.812190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cea59ff4-18a5-4fb5-8b9b-1a06f0be15ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:15.880252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1276/2568] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:15.891299 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b908f1-00ec-47c1-8f06-f52cc280458d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:15.893030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-76b908f1-00ec-47c1-8f06-f52cc280458d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:15.947054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:15.952403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b908f1-00ec-47c1-8f06-f52cc280458d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:15.956030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bdacb-40a3-4434-ba82-c41a9fb5c5e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:15.956628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdacb-40a3-4434-ba82-c41a9fb5c5e9 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:15.956911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdacb-40a3-4434-ba82-c41a9fb5c5e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:15.957214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bdacb-40a3-4434-ba82-c41a9fb5c5e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:15.966362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bdacb-40a3-4434-ba82-c41a9fb5c5e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:15.967925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bdacb-40a3-4434-ba82-c41a9fb5c5e9 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:15.978817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1293/2569] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:16.000640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea59ff4-18a5-4fb5-8b9b-1a06f0be15ae None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:16.062555 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea59ff4-18a5-4fb5-8b9b-1a06f0be15ae None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:16.067168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:16.067828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:16.068127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:16.068394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] PATH_INFO: `/v3/users/f67789ef812d4147b23730170028171b` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:16.069532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=f67789ef812d4147b23730170028171b)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:16.071534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:16.357283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f67789ef812d4147b23730170028171b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:16.358455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:16.364431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f67789ef812d4147b23730170028171b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:16.365083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f67789ef812d4147b23730170028171b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:16.365674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f67789ef812d4147b23730170028171b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:16.479893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f67789ef812d4147b23730170028171b'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:16.497774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1277/2570] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:15 2022] DELETE /identity/v3/users/f67789ef812d4147b23730170028171b => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:16.502180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aafe4-3fc6-4e2f-ac68-0406493d169c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:16.502530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aafe4-3fc6-4e2f-ac68-0406493d169c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:16.502757 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64aafe4-3fc6-4e2f-ac68-0406493d169c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:16.523077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d64aafe4-3fc6-4e2f-ac68-0406493d169c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:16.524342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d64aafe4-3fc6-4e2f-ac68-0406493d169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:16.596836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1294/2571] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:16.607999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:16.609683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:16.670166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f2c7c-000f-4092-815d-05a2ad7bedfe admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:16.674172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfd169-0734-4ff5-aa77-dadd412c41f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:16.674877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd169-0734-4ff5-aa77-dadd412c41f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:16.675162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd169-0734-4ff5-aa77-dadd412c41f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:16.675438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfd169-0734-4ff5-aa77-dadd412c41f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:16.685472 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfd169-0734-4ff5-aa77-dadd412c41f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:16.686911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfd169-0734-4ff5-aa77-dadd412c41f8 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:16.697763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1278/2572] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:17.338393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aafe4-3fc6-4e2f-ac68-0406493d169c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:17.339918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d64aafe4-3fc6-4e2f-ac68-0406493d169c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:17.353312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64aafe4-3fc6-4e2f-ac68-0406493d169c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:17.357071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:17.357700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:17.357980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:17.358254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] PATH_INFO: `/v3/projects/7c41c14f1bb6448f8acf2511915ad33f` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:17.359392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c41c14f1bb6448f8acf2511915ad33f)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:17.361329 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:17.514187 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c41c14f1bb6448f8acf2511915ad33f', 'request_id': 'req-90cb3961-a46a-4789-8df4-59d252fdde03'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:17.588422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c41c14f1bb6448f8acf2511915ad33f', 'request_id': 'req-90cb3961-a46a-4789-8df4-59d252fdde03'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:17.594981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c41c14f1bb6448f8acf2511915ad33f', 'request_id': 'req-90cb3961-a46a-4789-8df4-59d252fdde03'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:17.606366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] The token cache is being invalidate because project 7c41c14f1bb6448f8acf2511915ad33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:17.613720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:17.613720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-90cb3961-a46a-4789-8df4-59d252fdde03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:17.613720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1295/2573] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:17 2022] DELETE /identity/v3/projects/7c41c14f1bb6448f8acf2511915ad33f => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:17.614281 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5607f-0742-457a-83cf-44c21406e42c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:17.614719 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5607f-0742-457a-83cf-44c21406e42c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:17.614852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5607f-0742-457a-83cf-44c21406e42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:17.634205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-01d5607f-0742-457a-83cf-44c21406e42c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:17.635436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-01d5607f-0742-457a-83cf-44c21406e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:17.693720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1279/2574] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:17.702528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6df56d-fe09-4f20-8db5-91459fc99cfc None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:17.702814 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6df56d-fe09-4f20-8db5-91459fc99cfc None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:17.703090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6df56d-fe09-4f20-8db5-91459fc99cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:17.724671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ef6df56d-fe09-4f20-8db5-91459fc99cfc None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:17.726131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ef6df56d-fe09-4f20-8db5-91459fc99cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:17.734314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1296/2575] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:17.738634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5607f-0742-457a-83cf-44c21406e42c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:17.748360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5607f-0742-457a-83cf-44c21406e42c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:17.753069 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8098-8dd8-4470-9e03-5caa0fae4371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:17.753676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8098-8dd8-4470-9e03-5caa0fae4371 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:17.753960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8098-8dd8-4470-9e03-5caa0fae4371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:17.754232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f8098-8dd8-4470-9e03-5caa0fae4371 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:17.754879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8098-8dd8-4470-9e03-5caa0fae4371 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:58:17.755204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8098-8dd8-4470-9e03-5caa0fae4371 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:17.756800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f8098-8dd8-4470-9e03-5caa0fae4371 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:17.769694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1280/2576] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:58:17.773953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6df56d-fe09-4f20-8db5-91459fc99cfc None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:17.783260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6df56d-fe09-4f20-8db5-91459fc99cfc None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:17.788844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3ffe9-8cbf-410e-a7d3-2560ec13d3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:17.789435 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3ffe9-8cbf-410e-a7d3-2560ec13d3c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:17.789713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3ffe9-8cbf-410e-a7d3-2560ec13d3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:17.789981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3ffe9-8cbf-410e-a7d3-2560ec13d3c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:17.790603 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3ffe9-8cbf-410e-a7d3-2560ec13d3c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:17.792519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3ffe9-8cbf-410e-a7d3-2560ec13d3c2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:17.870131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1297/2577] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:58:17 2022] POST /identity/v3/projects => generated 359 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:17.881597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8098-8dd8-4470-9e03-5caa0fae4371 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:17.891768 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f8098-8dd8-4470-9e03-5caa0fae4371 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:17.940681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:17.947328 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77f084-a041-483d-b509-a446d2194b44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:17.954566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77f084-a041-483d-b509-a446d2194b44 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:17.954566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77f084-a041-483d-b509-a446d2194b44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:17.954566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77f084-a041-483d-b509-a446d2194b44 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:17.954566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77f084-a041-483d-b509-a446d2194b44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:17.954566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77f084-a041-483d-b509-a446d2194b44 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:18.028096 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1281/2578] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:58:17 2022] POST /identity/v3/users => generated 280 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:18.032253 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3ffe9-8cbf-410e-a7d3-2560ec13d3c2 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:18.043011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3ffe9-8cbf-410e-a7d3-2560ec13d3c2 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:18.047578 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c585f-412d-47df-8d1c-499d68520933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:18.048207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c585f-412d-47df-8d1c-499d68520933 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:18.048488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c585f-412d-47df-8d1c-499d68520933 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:18.048761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774c585f-412d-47df-8d1c-499d68520933 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:18.049397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c585f-412d-47df-8d1c-499d68520933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:18.050991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774c585f-412d-47df-8d1c-499d68520933 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:18.060663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1298/2579] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:18.064545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77f084-a041-483d-b509-a446d2194b44 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:18.074741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77f084-a041-483d-b509-a446d2194b44 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:18.079303 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67841f0-ecfd-4a23-9a67-7b3b998dcf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:18.079926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67841f0-ecfd-4a23-9a67-7b3b998dcf88 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:18.080206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67841f0-ecfd-4a23-9a67-7b3b998dcf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:18.080479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67841f0-ecfd-4a23-9a67-7b3b998dcf88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:18.081112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67841f0-ecfd-4a23-9a67-7b3b998dcf88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:18.083306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67841f0-ecfd-4a23-9a67-7b3b998dcf88 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:18.093587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1282/2580] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:58:18.098236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c585f-412d-47df-8d1c-499d68520933 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:18.108220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774c585f-412d-47df-8d1c-499d68520933 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:18.112693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691b00f-5acd-424c-9f14-48c4116331d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:18.113369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691b00f-5acd-424c-9f14-48c4116331d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:18.113646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691b00f-5acd-424c-9f14-48c4116331d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:18.113916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4691b00f-5acd-424c-9f14-48c4116331d6 admin admin] PATH_INFO: `/v3/projects/b65be0bb93de4244954ea43f65d74eb5/users/181b18855fef40f3a9b2dad3bd9bff07/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:18.128136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691b00f-5acd-424c-9f14-48c4116331d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b65be0bb93de4244954ea43f65d74eb5, user_id=181b18855fef40f3a9b2dad3bd9bff07, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:18.131185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4691b00f-5acd-424c-9f14-48c4116331d6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:18.211103 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1299/2581] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:18 2022] PUT /identity/v3/projects/b65be0bb93de4244954ea43f65d74eb5/users/181b18855fef40f3a9b2dad3bd9bff07/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:18.221277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8736e-e947-4d9d-9277-49fc15a15b64 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:18.221557 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8736e-e947-4d9d-9277-49fc15a15b64 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:18.223776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8736e-e947-4d9d-9277-49fc15a15b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:18.248903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-28f8736e-e947-4d9d-9277-49fc15a15b64 None None] MFA Rules not processed for user `181b18855fef40f3a9b2dad3bd9bff07`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:18.250096 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-28f8736e-e947-4d9d-9277-49fc15a15b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:18.312511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1283/2582] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:18 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:18.345692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691b00f-5acd-424c-9f14-48c4116331d6 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:18.347490 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4691b00f-5acd-424c-9f14-48c4116331d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:18.358385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:18.410620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4691b00f-5acd-424c-9f14-48c4116331d6 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:18.414333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6bd90-85fa-4587-af88-209c282f2dc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:18.414957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6bd90-85fa-4587-af88-209c282f2dc0 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:18.415286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6bd90-85fa-4587-af88-209c282f2dc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:18.415596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6bd90-85fa-4587-af88-209c282f2dc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:18.423964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6bd90-85fa-4587-af88-209c282f2dc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:18.425931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6bd90-85fa-4587-af88-209c282f2dc0 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:18.434401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1300/2583] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:18 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:18.450691 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8736e-e947-4d9d-9277-49fc15a15b64 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:18.511177 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8736e-e947-4d9d-9277-49fc15a15b64 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:18.515714 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:18.516332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:18.516608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:18.516884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] PATH_INFO: `/v3/users/181b18855fef40f3a9b2dad3bd9bff07` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:18.517986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] RBAC: Authorizing `identity:delete_user(user_id=181b18855fef40f3a9b2dad3bd9bff07)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:18.519928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:18.761870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181b18855fef40f3a9b2dad3bd9bff07'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:18.769056 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181b18855fef40f3a9b2dad3bd9bff07'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:18.769720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181b18855fef40f3a9b2dad3bd9bff07'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:18.770320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181b18855fef40f3a9b2dad3bd9bff07'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:18.860733 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181b18855fef40f3a9b2dad3bd9bff07'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:18.862832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:18.879317 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1284/2584] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:18 2022] DELETE /identity/v3/users/181b18855fef40f3a9b2dad3bd9bff07 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:18.883832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9ca00-52ea-4c36-8227-01464a12032b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:18.884119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9ca00-52ea-4c36-8227-01464a12032b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:18.884388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9ca00-52ea-4c36-8227-01464a12032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:18.902867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-20e9ca00-52ea-4c36-8227-01464a12032b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:18.904134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-20e9ca00-52ea-4c36-8227-01464a12032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:18.964734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1301/2585] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:18.975348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:18.976942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:19.033743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645b4c9-31e0-4c02-bd24-1976d804a11e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:19.037971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5e7e-1a73-4634-a98c-97888606b852 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:19.038577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5e7e-1a73-4634-a98c-97888606b852 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:19.038855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5e7e-1a73-4634-a98c-97888606b852 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:19.039129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5e7e-1a73-4634-a98c-97888606b852 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:19.048467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa5e7e-1a73-4634-a98c-97888606b852 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:19.049894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa5e7e-1a73-4634-a98c-97888606b852 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:19.060416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1285/2586] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:19.514157 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9ca00-52ea-4c36-8227-01464a12032b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:19.515734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-20e9ca00-52ea-4c36-8227-01464a12032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:19.528222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9ca00-52ea-4c36-8227-01464a12032b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:19.532971 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:19.533686 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:19.534054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:19.534472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] PATH_INFO: `/v3/projects/b65be0bb93de4244954ea43f65d74eb5` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:19.536224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b65be0bb93de4244954ea43f65d74eb5)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:19.538237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:19.657134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b65be0bb93de4244954ea43f65d74eb5', 'request_id': 'req-838f4927-50dc-4ab2-8b77-81b12bb93d7d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:19.736284 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b65be0bb93de4244954ea43f65d74eb5', 'request_id': 'req-838f4927-50dc-4ab2-8b77-81b12bb93d7d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:19.743232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b65be0bb93de4244954ea43f65d74eb5', 'request_id': 'req-838f4927-50dc-4ab2-8b77-81b12bb93d7d'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:19.754344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] The token cache is being invalidate because project b65be0bb93de4244954ea43f65d74eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:19.754638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:19.755282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-838f4927-50dc-4ab2-8b77-81b12bb93d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:19.756791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1302/2587] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:19 2022] DELETE /identity/v3/projects/b65be0bb93de4244954ea43f65d74eb5 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:19.761669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad3ac1-54a2-4792-a6c0-15de33fef604 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:19.761955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad3ac1-54a2-4792-a6c0-15de33fef604 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:19.762495 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad3ac1-54a2-4792-a6c0-15de33fef604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:19.781922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-71ad3ac1-54a2-4792-a6c0-15de33fef604 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:19.788841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-71ad3ac1-54a2-4792-a6c0-15de33fef604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:19.840608 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1286/2588] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:19.848530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d34533-205c-4c9c-8434-759bdc3811fb None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:19.848766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d34533-205c-4c9c-8434-759bdc3811fb None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:19.849123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d34533-205c-4c9c-8434-759bdc3811fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:19.868547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-78d34533-205c-4c9c-8434-759bdc3811fb None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:19.869748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-78d34533-205c-4c9c-8434-759bdc3811fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:19.877534 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1303/2589] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:19.889165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad3ac1-54a2-4792-a6c0-15de33fef604 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:19.899561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad3ac1-54a2-4792-a6c0-15de33fef604 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:19.904192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dfbaa-c94f-4e68-b33e-b0d9ccd743c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:19.904794 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dfbaa-c94f-4e68-b33e-b0d9ccd743c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:19.905078 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dfbaa-c94f-4e68-b33e-b0d9ccd743c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:19.905357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178dfbaa-c94f-4e68-b33e-b0d9ccd743c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:19.906012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dfbaa-c94f-4e68-b33e-b0d9ccd743c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:58:19.906323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dfbaa-c94f-4e68-b33e-b0d9ccd743c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:19.907959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178dfbaa-c94f-4e68-b33e-b0d9ccd743c6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:19.919431 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1287/2590] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:58:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:58:19.923669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d34533-205c-4c9c-8434-759bdc3811fb None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:19.933239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d34533-205c-4c9c-8434-759bdc3811fb None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:19.937823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c74f91-2bce-4e49-85e9-da98b5ee7f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:19.938411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c74f91-2bce-4e49-85e9-da98b5ee7f37 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:19.938691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c74f91-2bce-4e49-85e9-da98b5ee7f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:19.938964 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c74f91-2bce-4e49-85e9-da98b5ee7f37 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:19.939645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c74f91-2bce-4e49-85e9-da98b5ee7f37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:19.942074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c74f91-2bce-4e49-85e9-da98b5ee7f37 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:20.052082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1304/2591] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:58:19 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:20.056241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dfbaa-c94f-4e68-b33e-b0d9ccd743c6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:20.066886 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178dfbaa-c94f-4e68-b33e-b0d9ccd743c6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:20.123635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b5333-9923-49a9-95e7-da53f5b431d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:20.124171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b5333-9923-49a9-95e7-da53f5b431d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.124453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b5333-9923-49a9-95e7-da53f5b431d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.124728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b5333-9923-49a9-95e7-da53f5b431d8 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.125356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b5333-9923-49a9-95e7-da53f5b431d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:20.127257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349b5333-9923-49a9-95e7-da53f5b431d8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:20.228541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1288/2592] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:58:20 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:20.232636 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c74f91-2bce-4e49-85e9-da98b5ee7f37 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:20.243399 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c74f91-2bce-4e49-85e9-da98b5ee7f37 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:20.250185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90ec6c-0039-4bd3-90fe-9ae55d895431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:20.250185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90ec6c-0039-4bd3-90fe-9ae55d895431 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.250185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90ec6c-0039-4bd3-90fe-9ae55d895431 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.250185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90ec6c-0039-4bd3-90fe-9ae55d895431 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.250572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90ec6c-0039-4bd3-90fe-9ae55d895431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:20.252230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90ec6c-0039-4bd3-90fe-9ae55d895431 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:20.254225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:20.263483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1305/2593] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:20.267309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b5333-9923-49a9-95e7-da53f5b431d8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:20.272636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:20.277953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b5333-9923-49a9-95e7-da53f5b431d8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:20.282619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c05ce77-ff1e-4467-9d52-d3cc13660728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:20.283213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05ce77-ff1e-4467-9d52-d3cc13660728 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.283498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05ce77-ff1e-4467-9d52-d3cc13660728 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.283806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c05ce77-ff1e-4467-9d52-d3cc13660728 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.284453 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05ce77-ff1e-4467-9d52-d3cc13660728 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:20.286036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c05ce77-ff1e-4467-9d52-d3cc13660728 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:20.296377 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1289/2594] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:20.304533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90ec6c-0039-4bd3-90fe-9ae55d895431 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:20.314497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90ec6c-0039-4bd3-90fe-9ae55d895431 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:20.320168 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba811e-8567-4d22-a262-fcd58eba0227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:20.320803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba811e-8567-4d22-a262-fcd58eba0227 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.321082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba811e-8567-4d22-a262-fcd58eba0227 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.321361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba811e-8567-4d22-a262-fcd58eba0227 admin admin] PATH_INFO: `/v3/projects/e4b346fc24b04dfba08fdea9cd527df5/users/728f62c96c164185a5e661e4b6930ccd/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.336065 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba811e-8567-4d22-a262-fcd58eba0227 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4b346fc24b04dfba08fdea9cd527df5, user_id=728f62c96c164185a5e661e4b6930ccd, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:20.338665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba811e-8567-4d22-a262-fcd58eba0227 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:20.416907 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1306/2595] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:20 2022] PUT /identity/v3/projects/e4b346fc24b04dfba08fdea9cd527df5/users/728f62c96c164185a5e661e4b6930ccd/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:20.428827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91070c0a-2a95-422b-8765-b0ee767c600c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.430121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91070c0a-2a95-422b-8765-b0ee767c600c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.430121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91070c0a-2a95-422b-8765-b0ee767c600c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.456168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-91070c0a-2a95-422b-8765-b0ee767c600c None None] MFA Rules not processed for user `728f62c96c164185a5e661e4b6930ccd`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:20.458801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-91070c0a-2a95-422b-8765-b0ee767c600c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:20.520288 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1290/2596] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:20.524833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba811e-8567-4d22-a262-fcd58eba0227 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:20.583973 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba811e-8567-4d22-a262-fcd58eba0227 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:20.588646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3da1-a34a-44c2-b77b-bbcff35d85b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:20.589254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3da1-a34a-44c2-b77b-bbcff35d85b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.589538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3da1-a34a-44c2-b77b-bbcff35d85b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.589811 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8b3da1-a34a-44c2-b77b-bbcff35d85b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.590454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b3da1-a34a-44c2-b77b-bbcff35d85b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:20.592403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8b3da1-a34a-44c2-b77b-bbcff35d85b1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:20.709755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1307/2597] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:58:20 2022] POST /identity/v3/projects => generated 383 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:58:20.716605 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91070c0a-2a95-422b-8765-b0ee767c600c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:20.725834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91070c0a-2a95-422b-8765-b0ee767c600c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:20.780716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae81ab-08f7-4b63-8d54-98d1e1681bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:20.781387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae81ab-08f7-4b63-8d54-98d1e1681bb0 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.781611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae81ab-08f7-4b63-8d54-98d1e1681bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.781871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae81ab-08f7-4b63-8d54-98d1e1681bb0 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.782498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae81ab-08f7-4b63-8d54-98d1e1681bb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:20.785068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ae81ab-08f7-4b63-8d54-98d1e1681bb0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:20.867363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1291/2598] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:58:20 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:20.871293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3da1-a34a-44c2-b77b-bbcff35d85b1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:20.881538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8b3da1-a34a-44c2-b77b-bbcff35d85b1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:20.886149 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fe87d-c300-453f-a435-3bcf27994c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:20.886738 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fe87d-c300-453f-a435-3bcf27994c61 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.887026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fe87d-c300-453f-a435-3bcf27994c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.887305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52fe87d-c300-453f-a435-3bcf27994c61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.887984 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fe87d-c300-453f-a435-3bcf27994c61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:20.892453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52fe87d-c300-453f-a435-3bcf27994c61 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:20.900266 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1308/2599] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:20.904123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae81ab-08f7-4b63-8d54-98d1e1681bb0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:20.914846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae81ab-08f7-4b63-8d54-98d1e1681bb0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:20.919436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e82913-cd81-444e-bcaf-4082a2d15298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:20.920059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82913-cd81-444e-bcaf-4082a2d15298 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.920340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82913-cd81-444e-bcaf-4082a2d15298 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.920615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e82913-cd81-444e-bcaf-4082a2d15298 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.921263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e82913-cd81-444e-bcaf-4082a2d15298 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:20.922831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e82913-cd81-444e-bcaf-4082a2d15298 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:20.932661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1292/2600] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:20.936880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fe87d-c300-453f-a435-3bcf27994c61 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:20.946561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52fe87d-c300-453f-a435-3bcf27994c61 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:20.951109 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952d93a-305a-4a80-ab41-755d54e0c056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:20.951771 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952d93a-305a-4a80-ab41-755d54e0c056 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:20.952055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952d93a-305a-4a80-ab41-755d54e0c056 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:20.952339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952d93a-305a-4a80-ab41-755d54e0c056 admin admin] PATH_INFO: `/v3/projects/cdd3ecc2d6b1438d9540757b6268edfe/users/3dde92119df448508a04cc9ba4981a5b/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:20.967060 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952d93a-305a-4a80-ab41-755d54e0c056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd3ecc2d6b1438d9540757b6268edfe, user_id=3dde92119df448508a04cc9ba4981a5b, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:20.969700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952d93a-305a-4a80-ab41-755d54e0c056 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:21.055917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1309/2601] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:20 2022] PUT /identity/v3/projects/cdd3ecc2d6b1438d9540757b6268edfe/users/3dde92119df448508a04cc9ba4981a5b/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:21.066575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c7b63-8cca-423c-8456-b01372aa7d0b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:21.066863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c7b63-8cca-423c-8456-b01372aa7d0b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:21.067140 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c7b63-8cca-423c-8456-b01372aa7d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:21.094998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-596c7b63-8cca-423c-8456-b01372aa7d0b None None] MFA Rules not processed for user `3dde92119df448508a04cc9ba4981a5b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:21.096245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-596c7b63-8cca-423c-8456-b01372aa7d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:21.144438 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:21.161419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1293/2602] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:21.165892 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952d93a-305a-4a80-ab41-755d54e0c056 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:21.226449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952d93a-305a-4a80-ab41-755d54e0c056 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:21.230911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e1d9-0aa5-4384-9bf4-f8002f9d470f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:21.231501 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e1d9-0aa5-4384-9bf4-f8002f9d470f admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:21.231807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e1d9-0aa5-4384-9bf4-f8002f9d470f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:21.232077 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1e1d9-0aa5-4384-9bf4-f8002f9d470f admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:21.232698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1e1d9-0aa5-4384-9bf4-f8002f9d470f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:21.234568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1e1d9-0aa5-4384-9bf4-f8002f9d470f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:21.327546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1310/2603] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:58:21 2022] POST /identity/v3/projects => generated 385 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:21.328641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c7b63-8cca-423c-8456-b01372aa7d0b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:21.339372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c7b63-8cca-423c-8456-b01372aa7d0b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:21.399738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caab30-3dc6-4486-8dd2-a49ac55575f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:21.400353 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caab30-3dc6-4486-8dd2-a49ac55575f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:21.400631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caab30-3dc6-4486-8dd2-a49ac55575f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:21.400901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83caab30-3dc6-4486-8dd2-a49ac55575f6 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:21.401537 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83caab30-3dc6-4486-8dd2-a49ac55575f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:21.403465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83caab30-3dc6-4486-8dd2-a49ac55575f6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:21.519067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1294/2604] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:58:21 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:58:21.523382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e1d9-0aa5-4384-9bf4-f8002f9d470f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:21.533736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1e1d9-0aa5-4384-9bf4-f8002f9d470f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:21.539003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5099ef-902a-47f0-8027-cff57971fec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:21.539624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5099ef-902a-47f0-8027-cff57971fec1 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:21.539911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5099ef-902a-47f0-8027-cff57971fec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:21.540188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5099ef-902a-47f0-8027-cff57971fec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:21.540889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5099ef-902a-47f0-8027-cff57971fec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:21.542486 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5099ef-902a-47f0-8027-cff57971fec1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:21.543779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:21.553474 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1311/2605] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:21.557654 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caab30-3dc6-4486-8dd2-a49ac55575f6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:21.567620 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83caab30-3dc6-4486-8dd2-a49ac55575f6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:21.575986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e5d77-5a48-43d3-a2d6-8e314b41facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:21.575986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e5d77-5a48-43d3-a2d6-8e314b41facb admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:21.575986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e5d77-5a48-43d3-a2d6-8e314b41facb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:21.575986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751e5d77-5a48-43d3-a2d6-8e314b41facb admin admin] PATH_INFO: `/v3/projects/e7e1dec494124c7994326793f82629b3/users/054376d3072e4ffba1a187222491c4d6/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:21.588758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e5d77-5a48-43d3-a2d6-8e314b41facb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e1dec494124c7994326793f82629b3, user_id=054376d3072e4ffba1a187222491c4d6, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:21.591397 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751e5d77-5a48-43d3-a2d6-8e314b41facb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:21.690545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1295/2606] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:21 2022] PUT /identity/v3/projects/e7e1dec494124c7994326793f82629b3/users/054376d3072e4ffba1a187222491c4d6/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:58:21.694620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5099ef-902a-47f0-8027-cff57971fec1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:21.704453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5099ef-902a-47f0-8027-cff57971fec1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:21.760748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc9f674-ce2c-41e9-a6d4-18c69f2dc0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:21.761391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f674-ce2c-41e9-a6d4-18c69f2dc0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:21.761618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f674-ce2c-41e9-a6d4-18c69f2dc0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:21.761888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc9f674-ce2c-41e9-a6d4-18c69f2dc0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:21.762520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f674-ce2c-41e9-a6d4-18c69f2dc0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:21.764180 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc9f674-ce2c-41e9-a6d4-18c69f2dc0f2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:21.774046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1312/2607] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:21.778192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e5d77-5a48-43d3-a2d6-8e314b41facb admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:21.789224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751e5d77-5a48-43d3-a2d6-8e314b41facb admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:21.793900 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d1952-0115-4e6f-a65f-1ec966031362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:21.794543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d1952-0115-4e6f-a65f-1ec966031362 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:21.794825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d1952-0115-4e6f-a65f-1ec966031362 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:21.795097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d1952-0115-4e6f-a65f-1ec966031362 admin admin] PATH_INFO: `/v3/projects/e7e1dec494124c7994326793f82629b3/users/054376d3072e4ffba1a187222491c4d6/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:21.797048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d1952-0115-4e6f-a65f-1ec966031362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7e1dec494124c7994326793f82629b3, user_id=054376d3072e4ffba1a187222491c4d6, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:21.799706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d1952-0115-4e6f-a65f-1ec966031362 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:21.812966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1296/2608] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:21 2022] PUT /identity/v3/projects/e7e1dec494124c7994326793f82629b3/users/054376d3072e4ffba1a187222491c4d6/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:21.821703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07330f-63f8-4125-a0b3-1c840dc56b32 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:21.821978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07330f-63f8-4125-a0b3-1c840dc56b32 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:21.822260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c07330f-63f8-4125-a0b3-1c840dc56b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:21.849707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-3c07330f-63f8-4125-a0b3-1c840dc56b32 None None] MFA Rules not processed for user `054376d3072e4ffba1a187222491c4d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:21.851183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3c07330f-63f8-4125-a0b3-1c840dc56b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:21.919439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1313/2609] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:21.931655 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d1952-0115-4e6f-a65f-1ec966031362 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:21.933346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-ed2d1952-0115-4e6f-a65f-1ec966031362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:21.990340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d1952-0115-4e6f-a65f-1ec966031362 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:21.993978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15e49-8878-4a1b-a20c-daaa7aa30d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:21.994577 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15e49-8878-4a1b-a20c-daaa7aa30d6d service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:21.994857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15e49-8878-4a1b-a20c-daaa7aa30d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:21.995132 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15e49-8878-4a1b-a20c-daaa7aa30d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:22.047345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:22.049524 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c15e49-8878-4a1b-a20c-daaa7aa30d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:22.050947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c15e49-8878-4a1b-a20c-daaa7aa30d6d service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:22.059619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1297/2610] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:24.091922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07330f-63f8-4125-a0b3-1c840dc56b32 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:24.093353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3c07330f-63f8-4125-a0b3-1c840dc56b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:24.105433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c07330f-63f8-4125-a0b3-1c840dc56b32 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:24.108896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4451ff-6999-4a6e-b9c0-4b73d92ea414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:24.109483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4451ff-6999-4a6e-b9c0-4b73d92ea414 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:24.109764 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4451ff-6999-4a6e-b9c0-4b73d92ea414 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:24.110035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4451ff-6999-4a6e-b9c0-4b73d92ea414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:24.164439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4451ff-6999-4a6e-b9c0-4b73d92ea414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:24.165854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4451ff-6999-4a6e-b9c0-4b73d92ea414 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:24.174463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1314/2611] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:24 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:25.545368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15e49-8878-4a1b-a20c-daaa7aa30d6d service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:25.554288 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15e49-8878-4a1b-a20c-daaa7aa30d6d service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:25.557856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f81acf-db7a-48e8-9234-ae3cf58f5416 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:25.558451 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f81acf-db7a-48e8-9234-ae3cf58f5416 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:25.558729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f81acf-db7a-48e8-9234-ae3cf58f5416 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:25.558998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f81acf-db7a-48e8-9234-ae3cf58f5416 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:25.568316 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f81acf-db7a-48e8-9234-ae3cf58f5416 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:25.569717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f81acf-db7a-48e8-9234-ae3cf58f5416 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:25.579181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1298/2612] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:30.246498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4451ff-6999-4a6e-b9c0-4b73d92ea414 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:30.263598 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:30.306762 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4451ff-6999-4a6e-b9c0-4b73d92ea414 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:30.311880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:30.312496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:30.312774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:30.313045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] PATH_INFO: `/v3/users/728f62c96c164185a5e661e4b6930ccd` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:30.314134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=728f62c96c164185a5e661e4b6930ccd)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:30.316056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:30.542012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '728f62c96c164185a5e661e4b6930ccd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:30.548804 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '728f62c96c164185a5e661e4b6930ccd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:30.549457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '728f62c96c164185a5e661e4b6930ccd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:30.550114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '728f62c96c164185a5e661e4b6930ccd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:30.648317 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '728f62c96c164185a5e661e4b6930ccd'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:30.666717 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1315/2613] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:30 2022] DELETE /identity/v3/users/728f62c96c164185a5e661e4b6930ccd => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:30.671199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8737fae-7bbf-4a72-8c2f-d067a4e22737 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:30.671694 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8737fae-7bbf-4a72-8c2f-d067a4e22737 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:30.671880 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8737fae-7bbf-4a72-8c2f-d067a4e22737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:30.690764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a8737fae-7bbf-4a72-8c2f-d067a4e22737 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:30.692043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a8737fae-7bbf-4a72-8c2f-d067a4e22737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:30.752268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1299/2614] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:58:30.762819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:30.764384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:30.823238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77f412-53b0-4c51-837b-1dde8a445f73 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:30.827100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd10a8-4843-4f0d-abe0-a7daf9924f2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:30.827735 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd10a8-4843-4f0d-abe0-a7daf9924f2a service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:30.828022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd10a8-4843-4f0d-abe0-a7daf9924f2a service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:30.828300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcd10a8-4843-4f0d-abe0-a7daf9924f2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:30.837625 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd10a8-4843-4f0d-abe0-a7daf9924f2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:30.839064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcd10a8-4843-4f0d-abe0-a7daf9924f2a service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:30.849206 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1316/2615] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:31.347811 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8737fae-7bbf-4a72-8c2f-d067a4e22737 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:31.349521 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a8737fae-7bbf-4a72-8c2f-d067a4e22737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:31.362229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8737fae-7bbf-4a72-8c2f-d067a4e22737 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:31.366975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:31.367646 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:31.367928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:31.368198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] PATH_INFO: `/v3/projects/e4b346fc24b04dfba08fdea9cd527df5` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:31.369333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4b346fc24b04dfba08fdea9cd527df5)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:31.371237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:31.510232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4b346fc24b04dfba08fdea9cd527df5', 'request_id': 'req-3e845bcd-c646-4bee-beef-c3afb332f3cd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:31.619641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4b346fc24b04dfba08fdea9cd527df5', 'request_id': 'req-3e845bcd-c646-4bee-beef-c3afb332f3cd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:31.626983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4b346fc24b04dfba08fdea9cd527df5', 'request_id': 'req-3e845bcd-c646-4bee-beef-c3afb332f3cd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:31.637494 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] The token cache is being invalidate because project e4b346fc24b04dfba08fdea9cd527df5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:31.640389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:31.640389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:31.640389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1300/2616] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:31 2022] DELETE /identity/v3/projects/e4b346fc24b04dfba08fdea9cd527df5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:31.644778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd10a8-4843-4f0d-abe0-a7daf9924f2a service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:31.654515 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcd10a8-4843-4f0d-abe0-a7daf9924f2a service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:31.686906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:31.710737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:31.711449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:31.711795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:31.712071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] PATH_INFO: `/v3/users/3dde92119df448508a04cc9ba4981a5b` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:31.713183 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dde92119df448508a04cc9ba4981a5b)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:31.715161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:31.958287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dde92119df448508a04cc9ba4981a5b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:31.965172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dde92119df448508a04cc9ba4981a5b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:31.965827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dde92119df448508a04cc9ba4981a5b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:31.966460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dde92119df448508a04cc9ba4981a5b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:32.064239 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dde92119df448508a04cc9ba4981a5b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:32.082240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1317/2617] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:31 2022] DELETE /identity/v3/users/3dde92119df448508a04cc9ba4981a5b => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:32.535685 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:32.537171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:32.558168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e845bcd-c646-4bee-beef-c3afb332f3cd admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:32.618121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:32.618783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:32.619063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:32.619338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] PATH_INFO: `/v3/projects/cdd3ecc2d6b1438d9540757b6268edfe` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:32.620487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd3ecc2d6b1438d9540757b6268edfe)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:32.622380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:32.630333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:32.727831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd3ecc2d6b1438d9540757b6268edfe', 'request_id': 'req-1127a6d8-9a40-4295-bd94-68a686f62c4d'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:32.859586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd3ecc2d6b1438d9540757b6268edfe', 'request_id': 'req-1127a6d8-9a40-4295-bd94-68a686f62c4d'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:32.866484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd3ecc2d6b1438d9540757b6268edfe', 'request_id': 'req-1127a6d8-9a40-4295-bd94-68a686f62c4d'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:32.877757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] The token cache is being invalidate because project cdd3ecc2d6b1438d9540757b6268edfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:32.878051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:32.878716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:32.880237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1301/2618] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:32 2022] DELETE /identity/v3/projects/cdd3ecc2d6b1438d9540757b6268edfe => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:32.884188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:32.885610 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:32.898715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66da3e2d-1024-422e-b827-c4edc0a0325f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:32.954249 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:32.955368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:32.955683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:32.955959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] PATH_INFO: `/v3/users/054376d3072e4ffba1a187222491c4d6` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:32.957224 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] RBAC: Authorizing `identity:delete_user(user_id=054376d3072e4ffba1a187222491c4d6)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:32.959126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:33.187572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '054376d3072e4ffba1a187222491c4d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:33.195089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '054376d3072e4ffba1a187222491c4d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:33.195772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '054376d3072e4ffba1a187222491c4d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:33.196385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '054376d3072e4ffba1a187222491c4d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:33.198874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:33.293563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cee08be3-041a-48b4-81ec-d119df70300f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '054376d3072e4ffba1a187222491c4d6'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:33.323497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1318/2619] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:32 2022] DELETE /identity/v3/users/054376d3072e4ffba1a187222491c4d6 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:33.779204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:33.780831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:33.796356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1127a6d8-9a40-4295-bd94-68a686f62c4d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:33.856734 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:33.857321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:33.857602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:33.857878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] PATH_INFO: `/v3/projects/e7e1dec494124c7994326793f82629b3` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:33.859032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7e1dec494124c7994326793f82629b3)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:33.860955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:33.967424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7e1dec494124c7994326793f82629b3', 'request_id': 'req-819bdab8-4150-4be2-bfe5-257e5a742b62'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:34.104484 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7e1dec494124c7994326793f82629b3', 'request_id': 'req-819bdab8-4150-4be2-bfe5-257e5a742b62'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:34.114562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7e1dec494124c7994326793f82629b3', 'request_id': 'req-819bdab8-4150-4be2-bfe5-257e5a742b62'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:34.122510 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] The token cache is being invalidate because project e7e1dec494124c7994326793f82629b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:34.122797 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:34.123427 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-819bdab8-4150-4be2-bfe5-257e5a742b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:34.124929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1302/2620] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:33 2022] DELETE /identity/v3/projects/e7e1dec494124c7994326793f82629b3 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:34.129733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d063ad-5ca4-4d74-8aed-9923a4497b1d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:34.130234 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d063ad-5ca4-4d74-8aed-9923a4497b1d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:34.130364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d063ad-5ca4-4d74-8aed-9923a4497b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:34.149961 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-f3d063ad-5ca4-4d74-8aed-9923a4497b1d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:34.151142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f3d063ad-5ca4-4d74-8aed-9923a4497b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:34.207560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1319/2621] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:34.215312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9f4f4-6fd3-4f9c-95c0-e071324f29be None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:34.215676 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9f4f4-6fd3-4f9c-95c0-e071324f29be None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:34.215960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd9f4f4-6fd3-4f9c-95c0-e071324f29be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:34.236282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-acd9f4f4-6fd3-4f9c-95c0-e071324f29be None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:34.237550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-acd9f4f4-6fd3-4f9c-95c0-e071324f29be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:34.245388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1303/2622] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:34.249456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d063ad-5ca4-4d74-8aed-9923a4497b1d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:34.259918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d063ad-5ca4-4d74-8aed-9923a4497b1d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:34.269067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fdaa5-69b9-41de-b994-40362e3966f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:34.269667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fdaa5-69b9-41de-b994-40362e3966f8 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:34.269952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fdaa5-69b9-41de-b994-40362e3966f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:34.270229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9fdaa5-69b9-41de-b994-40362e3966f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:34.270875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fdaa5-69b9-41de-b994-40362e3966f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:58:34.271181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fdaa5-69b9-41de-b994-40362e3966f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:34.272842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9fdaa5-69b9-41de-b994-40362e3966f8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:34.286564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1320/2623] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:58:34.291098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9f4f4-6fd3-4f9c-95c0-e071324f29be None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:34.300341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd9f4f4-6fd3-4f9c-95c0-e071324f29be None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:34.305232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98387256-2bd6-430a-a329-1d9d06f11953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:34.306296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98387256-2bd6-430a-a329-1d9d06f11953 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:34.306296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98387256-2bd6-430a-a329-1d9d06f11953 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:34.306675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98387256-2bd6-430a-a329-1d9d06f11953 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:34.307321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98387256-2bd6-430a-a329-1d9d06f11953 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:34.309327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98387256-2bd6-430a-a329-1d9d06f11953 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:34.459799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:34.466922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1304/2624] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:58:34 2022] POST /identity/v3/projects => generated 373 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:34.473655 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fdaa5-69b9-41de-b994-40362e3966f8 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:34.483365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9fdaa5-69b9-41de-b994-40362e3966f8 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:34.550012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18b0a4-31bd-44c8-9296-f726e69bc5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:34.550641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18b0a4-31bd-44c8-9296-f726e69bc5f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:34.550920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18b0a4-31bd-44c8-9296-f726e69bc5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:34.551196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18b0a4-31bd-44c8-9296-f726e69bc5f3 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:34.551875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18b0a4-31bd-44c8-9296-f726e69bc5f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:34.553772 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18b0a4-31bd-44c8-9296-f726e69bc5f3 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:34.681955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1321/2625] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:58:34 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:58:34.686120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98387256-2bd6-430a-a329-1d9d06f11953 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:34.696580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98387256-2bd6-430a-a329-1d9d06f11953 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:34.701058 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f35d-09cf-4cb3-9763-fd830598cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:34.701657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f35d-09cf-4cb3-9763-fd830598cf52 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:34.702119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f35d-09cf-4cb3-9763-fd830598cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:34.702230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de2f35d-09cf-4cb3-9763-fd830598cf52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:34.702845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2f35d-09cf-4cb3-9763-fd830598cf52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:34.704442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de2f35d-09cf-4cb3-9763-fd830598cf52 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:34.714658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1305/2626] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:34.718430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18b0a4-31bd-44c8-9296-f726e69bc5f3 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:34.728587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18b0a4-31bd-44c8-9296-f726e69bc5f3 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:34.733350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa9688-93a0-4f5c-abe7-305e1038d645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:34.734596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa9688-93a0-4f5c-abe7-305e1038d645 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:34.734596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa9688-93a0-4f5c-abe7-305e1038d645 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:34.734596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa9688-93a0-4f5c-abe7-305e1038d645 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:34.735087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa9688-93a0-4f5c-abe7-305e1038d645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:34.736709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa9688-93a0-4f5c-abe7-305e1038d645 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:34.747005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1322/2627] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:34.750996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f35d-09cf-4cb3-9763-fd830598cf52 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:34.761589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de2f35d-09cf-4cb3-9763-fd830598cf52 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:34.766129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a289ba2-557f-4fdf-ac5a-7faf832db094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:34.766775 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a289ba2-557f-4fdf-ac5a-7faf832db094 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:34.767680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a289ba2-557f-4fdf-ac5a-7faf832db094 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:34.767966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a289ba2-557f-4fdf-ac5a-7faf832db094 admin admin] PATH_INFO: `/v3/projects/290b34a55e7b4f8faa1f7c3a5f80e6d1/users/0c5c90765b884a91b56f1cfb3f670793/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:34.782462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a289ba2-557f-4fdf-ac5a-7faf832db094 admin admin] RBAC: Authorizing `identity:create_grant(project_id=290b34a55e7b4f8faa1f7c3a5f80e6d1, user_id=0c5c90765b884a91b56f1cfb3f670793, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:34.785187 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a289ba2-557f-4fdf-ac5a-7faf832db094 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:34.883942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1306/2628] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:34 2022] PUT /identity/v3/projects/290b34a55e7b4f8faa1f7c3a5f80e6d1/users/0c5c90765b884a91b56f1cfb3f670793/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:34.894591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e13a-4fb6-4ab1-8c80-ba24d093b903 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:34.894898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e13a-4fb6-4ab1-8c80-ba24d093b903 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:34.895148 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a396e13a-4fb6-4ab1-8c80-ba24d093b903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:34.922920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-a396e13a-4fb6-4ab1-8c80-ba24d093b903 None None] MFA Rules not processed for user `0c5c90765b884a91b56f1cfb3f670793`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:34.924661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a396e13a-4fb6-4ab1-8c80-ba24d093b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:34.955708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:34.990370 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1323/2629] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:35.001033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a289ba2-557f-4fdf-ac5a-7faf832db094 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:35.007692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5a289ba2-557f-4fdf-ac5a-7faf832db094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:35.063156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a289ba2-557f-4fdf-ac5a-7faf832db094 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:35.067463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02b5d-afba-481b-b2d8-3863e0397e7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:35.068098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02b5d-afba-481b-b2d8-3863e0397e7e service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:35.068375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02b5d-afba-481b-b2d8-3863e0397e7e service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:35.068653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d02b5d-afba-481b-b2d8-3863e0397e7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:35.077136 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d02b5d-afba-481b-b2d8-3863e0397e7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:35.078550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d02b5d-afba-481b-b2d8-3863e0397e7e service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:35.087335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1307/2630] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:42.117406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396e13a-4fb6-4ab1-8c80-ba24d093b903 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:42.118897 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a396e13a-4fb6-4ab1-8c80-ba24d093b903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:42.175750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a396e13a-4fb6-4ab1-8c80-ba24d093b903 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:42.179304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f4d4a-8351-4d31-ba31-4e067f123ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:42.180009 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f4d4a-8351-4d31-ba31-4e067f123ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:42.180352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f4d4a-8351-4d31-ba31-4e067f123ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:42.180555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f4d4a-8351-4d31-ba31-4e067f123ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:42.182273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-579f4d4a-8351-4d31-ba31-4e067f123ad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:42.245261 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f4d4a-8351-4d31-ba31-4e067f123ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:42.246701 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f4d4a-8351-4d31-ba31-4e067f123ad3 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:42.257544 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1324/2631] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:45.083345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=42,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:46.485792 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02b5d-afba-481b-b2d8-3863e0397e7e service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:46.487336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-13d02b5d-afba-481b-b2d8-3863e0397e7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:46.502731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d02b5d-afba-481b-b2d8-3863e0397e7e service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:46.507165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:46.507815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:46.508091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:46.508361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] PATH_INFO: `/v3/users/35b0d1ed01c344acb96ab00c7c163e18` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:46.509707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35b0d1ed01c344acb96ab00c7c163e18)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:46.511635 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:46.718466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35b0d1ed01c344acb96ab00c7c163e18'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:46.726356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35b0d1ed01c344acb96ab00c7c163e18'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:46.727040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35b0d1ed01c344acb96ab00c7c163e18'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:46.727746 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35b0d1ed01c344acb96ab00c7c163e18'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:46.770776 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f4d4a-8351-4d31-ba31-4e067f123ad3 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:46.780403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f4d4a-8351-4d31-ba31-4e067f123ad3 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:46.784966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:46.785573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:46.785851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:46.786122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] PATH_INFO: `/v3/users/0c5c90765b884a91b56f1cfb3f670793` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:46.787218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c5c90765b884a91b56f1cfb3f670793)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:46.789155 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:46.805020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35b0d1ed01c344acb96ab00c7c163e18'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:46.825718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1308/2632] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:46 2022] DELETE /identity/v3/users/35b0d1ed01c344acb96ab00c7c163e18 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:46.986392 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c5c90765b884a91b56f1cfb3f670793'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:46.993374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c5c90765b884a91b56f1cfb3f670793'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:46.994044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c5c90765b884a91b56f1cfb3f670793'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:46.994668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c5c90765b884a91b56f1cfb3f670793'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:47.079926 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f64c0de0-6e68-44c4-8c3b-59afdc6b0602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c5c90765b884a91b56f1cfb3f670793'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:47.088112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:47.090184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:47.102199 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:47.121933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1325/2633] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:46 2022] DELETE /identity/v3/users/0c5c90765b884a91b56f1cfb3f670793 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:47.126850 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0c98-2139-40f3-91e3-317d45c2b4e7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:47.127136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0c98-2139-40f3-91e3-317d45c2b4e7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:47.127416 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39b0c98-2139-40f3-91e3-317d45c2b4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:47.146476 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-e39b0c98-2139-40f3-91e3-317d45c2b4e7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:47.147932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e39b0c98-2139-40f3-91e3-317d45c2b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:47.159473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a299258-f425-49e1-80c7-97d9cae9c5f2 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:47.209549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1326/2634] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:58:47.216136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0c98-2139-40f3-91e3-317d45c2b4e7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:47.217457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e39b0c98-2139-40f3-91e3-317d45c2b4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:47.217697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:47.218371 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:47.218656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:47.218934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] PATH_INFO: `/v3/projects/0bd9e9c5805645e983a3bec23f37c8ba` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:47.220128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd9e9c5805645e983a3bec23f37c8ba)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:47.222292 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:47.245668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:47.275736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39b0c98-2139-40f3-91e3-317d45c2b4e7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:47.279330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962961c5-ad2e-433a-8d95-0f0344b62b97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:47.279949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962961c5-ad2e-433a-8d95-0f0344b62b97 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:47.280228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962961c5-ad2e-433a-8d95-0f0344b62b97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:47.281001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962961c5-ad2e-433a-8d95-0f0344b62b97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:47.289854 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962961c5-ad2e-433a-8d95-0f0344b62b97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:47.291270 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962961c5-ad2e-433a-8d95-0f0344b62b97 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:47.301650 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1327/2635] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:58:47.338160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd9e9c5805645e983a3bec23f37c8ba', 'request_id': 'req-8ac31ed6-524c-446a-b65d-16813aeb9a06'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:47.439342 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd9e9c5805645e983a3bec23f37c8ba', 'request_id': 'req-8ac31ed6-524c-446a-b65d-16813aeb9a06'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:47.446160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd9e9c5805645e983a3bec23f37c8ba', 'request_id': 'req-8ac31ed6-524c-446a-b65d-16813aeb9a06'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:47.457090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] The token cache is being invalidate because project 0bd9e9c5805645e983a3bec23f37c8ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:47.457383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:47.458028 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-8ac31ed6-524c-446a-b65d-16813aeb9a06 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:47.459611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1309/2636] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:47 2022] DELETE /identity/v3/projects/0bd9e9c5805645e983a3bec23f37c8ba => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:58:47.464423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e221175-9811-4429-b766-f4481cedbc40 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:47.464711 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e221175-9811-4429-b766-f4481cedbc40 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:47.464988 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e221175-9811-4429-b766-f4481cedbc40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:47.486434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8e221175-9811-4429-b766-f4481cedbc40 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:47.487670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8e221175-9811-4429-b766-f4481cedbc40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:47.556030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1328/2637] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:47.565562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84efa4d-87e8-4ebc-8ffc-062e88d46766 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:47.566021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84efa4d-87e8-4ebc-8ffc-062e88d46766 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:47.568545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84efa4d-87e8-4ebc-8ffc-062e88d46766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:47.618800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b84efa4d-87e8-4ebc-8ffc-062e88d46766 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:47.620057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b84efa4d-87e8-4ebc-8ffc-062e88d46766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:47.628341 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1310/2638] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:47.640930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e221175-9811-4429-b766-f4481cedbc40 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:47.650594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e221175-9811-4429-b766-f4481cedbc40 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:47.655220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:47.656395 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:47.656682 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:47.656959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:47.657606 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:58:47.657910 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:47.659489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:47.671401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1329/2639] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:58:47.675758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84efa4d-87e8-4ebc-8ffc-062e88d46766 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:47.684838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84efa4d-87e8-4ebc-8ffc-062e88d46766 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:47.689708 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446edd1-6720-45bd-b698-f5df3f7d844d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:47.690306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446edd1-6720-45bd-b698-f5df3f7d844d admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:47.690586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446edd1-6720-45bd-b698-f5df3f7d844d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:47.690865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446edd1-6720-45bd-b698-f5df3f7d844d admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:47.691528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446edd1-6720-45bd-b698-f5df3f7d844d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:47.693423 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446edd1-6720-45bd-b698-f5df3f7d844d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:47.943835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:47.945714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:47.960890 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6922c3-0a95-49a1-977d-d906325bb30e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:47.974754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:47.974754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:47.974754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:47.974754 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] PATH_INFO: `/v3/projects/290b34a55e7b4f8faa1f7c3a5f80e6d1` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:47.975661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=290b34a55e7b4f8faa1f7c3a5f80e6d1)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:47.975661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:47.976013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1311/2640] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:58:47 2022] POST /identity/v3/projects => generated 365 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:58:47.978114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446edd1-6720-45bd-b698-f5df3f7d844d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:47.997793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:48.038759 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446edd1-6720-45bd-b698-f5df3f7d844d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:48.043290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede3e08-58a8-4a80-ab14-ac23b510bf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:48.043945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede3e08-58a8-4a80-ab14-ac23b510bf48 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:48.049005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede3e08-58a8-4a80-ab14-ac23b510bf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:48.049005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede3e08-58a8-4a80-ab14-ac23b510bf48 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:48.049005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede3e08-58a8-4a80-ab14-ac23b510bf48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:48.049005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede3e08-58a8-4a80-ab14-ac23b510bf48 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:48.136559 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '290b34a55e7b4f8faa1f7c3a5f80e6d1', 'request_id': 'req-d32b7ad6-4db8-447e-8088-7e049496cbb1'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:48.195464 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1312/2641] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:58:47 2022] POST /identity/v3/users => generated 283 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:58:48.199662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede3e08-58a8-4a80-ab14-ac23b510bf48 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:48.209587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede3e08-58a8-4a80-ab14-ac23b510bf48 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:48.217355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '290b34a55e7b4f8faa1f7c3a5f80e6d1', 'request_id': 'req-d32b7ad6-4db8-447e-8088-7e049496cbb1'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:48.224821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '290b34a55e7b4f8faa1f7c3a5f80e6d1', 'request_id': 'req-d32b7ad6-4db8-447e-8088-7e049496cbb1'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:48.235238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] The token cache is being invalidate because project 290b34a55e7b4f8faa1f7c3a5f80e6d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:48.235550 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:48.236194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:48.237688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1330/2642] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:47 2022] DELETE /identity/v3/projects/290b34a55e7b4f8faa1f7c3a5f80e6d1 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:48.276580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb140d6-c4d1-470f-81ab-e66144682273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:48.277219 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb140d6-c4d1-470f-81ab-e66144682273 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:48.277508 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb140d6-c4d1-470f-81ab-e66144682273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:48.277846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb140d6-c4d1-470f-81ab-e66144682273 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:48.278724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb140d6-c4d1-470f-81ab-e66144682273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:48.280408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb140d6-c4d1-470f-81ab-e66144682273 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:48.292687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1313/2643] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:58:48.297042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:48.298456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:48.312585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b7ad6-4db8-447e-8088-7e049496cbb1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:48.317480 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007717-0084-44df-9887-432a93d30ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:48.318108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007717-0084-44df-9887-432a93d30ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:48.318388 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007717-0084-44df-9887-432a93d30ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:48.318659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007717-0084-44df-9887-432a93d30ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:48.319322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd007717-0084-44df-9887-432a93d30ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:48.321005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd007717-0084-44df-9887-432a93d30ce8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:48.332906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1331/2644] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:58:48.337236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb140d6-c4d1-470f-81ab-e66144682273 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:48.348159 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb140d6-c4d1-470f-81ab-e66144682273 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:48.353677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c646-fa15-40e1-be39-5e3c9c2d7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:48.354363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c646-fa15-40e1-be39-5e3c9c2d7802 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:48.354645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c646-fa15-40e1-be39-5e3c9c2d7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:48.354921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6c646-fa15-40e1-be39-5e3c9c2d7802 admin admin] PATH_INFO: `/v3/projects/79bb43797d7c4ad5b66d4c3ec55bd558/users/aff30432d02b43f7b012b4ec1cd6ecbe/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:48.357474 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:48.371747 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6c646-fa15-40e1-be39-5e3c9c2d7802 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bb43797d7c4ad5b66d4c3ec55bd558, user_id=aff30432d02b43f7b012b4ec1cd6ecbe, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:48.375106 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6c646-fa15-40e1-be39-5e3c9c2d7802 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:48.462893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1314/2645] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:58:48 2022] PUT /identity/v3/projects/79bb43797d7c4ad5b66d4c3ec55bd558/users/aff30432d02b43f7b012b4ec1cd6ecbe/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:48.473472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3bba7-0221-488d-869f-77afeb8ed7e7 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:48.473762 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3bba7-0221-488d-869f-77afeb8ed7e7 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:48.474039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3bba7-0221-488d-869f-77afeb8ed7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:48.503479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-abf3bba7-0221-488d-869f-77afeb8ed7e7 None None] MFA Rules not processed for user `aff30432d02b43f7b012b4ec1cd6ecbe`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:48.507256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-abf3bba7-0221-488d-869f-77afeb8ed7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:48.568428 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1332/2646] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:48.579745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c646-fa15-40e1-be39-5e3c9c2d7802 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:48.581523 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a7a6c646-fa15-40e1-be39-5e3c9c2d7802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:48.639275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6c646-fa15-40e1-be39-5e3c9c2d7802 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:48.643827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7e2b5-8c6c-4170-bfe4-330fbca299df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:48.644415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e2b5-8c6c-4170-bfe4-330fbca299df service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:48.644697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e2b5-8c6c-4170-bfe4-330fbca299df service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:48.644972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7e2b5-8c6c-4170-bfe4-330fbca299df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:48.653195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7e2b5-8c6c-4170-bfe4-330fbca299df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:48.656266 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7e2b5-8c6c-4170-bfe4-330fbca299df service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:48.664184 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1315/2647] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:58.565557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:58:58.685811 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3bba7-0221-488d-869f-77afeb8ed7e7 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:58.753959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3bba7-0221-488d-869f-77afeb8ed7e7 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:58.758573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:58.759166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:58.759448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:58.759750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] PATH_INFO: `/v3/users/aff30432d02b43f7b012b4ec1cd6ecbe` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:58.760881 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff30432d02b43f7b012b4ec1cd6ecbe)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:58.762867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:58.969491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff30432d02b43f7b012b4ec1cd6ecbe'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:58.976853 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff30432d02b43f7b012b4ec1cd6ecbe'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:58.977522 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff30432d02b43f7b012b4ec1cd6ecbe'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:58.978225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff30432d02b43f7b012b4ec1cd6ecbe'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:59.088656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff30432d02b43f7b012b4ec1cd6ecbe'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:59.107129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1333/2648] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:58:58 2022] DELETE /identity/v3/users/aff30432d02b43f7b012b4ec1cd6ecbe => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:59.111598 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee96d2-3f67-4d83-9ff0-087b8725c081 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:59.112088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee96d2-3f67-4d83-9ff0-087b8725c081 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:59.112186 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee96d2-3f67-4d83-9ff0-087b8725c081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:59.130833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-58ee96d2-3f67-4d83-9ff0-087b8725c081 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:59.132059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-58ee96d2-3f67-4d83-9ff0-087b8725c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:59.188357 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1316/2649] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:58:59.205012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:59.206385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:59.261039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a17989-2e64-49b0-a24a-85c1a40031ca admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:59.264627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad845b7b-ec52-4b1f-bf7c-27d495e51cf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:59.265159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845b7b-ec52-4b1f-bf7c-27d495e51cf3 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:59.265436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845b7b-ec52-4b1f-bf7c-27d495e51cf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:59.265704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad845b7b-ec52-4b1f-bf7c-27d495e51cf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:59.274917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845b7b-ec52-4b1f-bf7c-27d495e51cf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:59.276352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad845b7b-ec52-4b1f-bf7c-27d495e51cf3 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:59.285657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1334/2650] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:58:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:58:59.679012 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee96d2-3f67-4d83-9ff0-087b8725c081 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:58:59.680563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-58ee96d2-3f67-4d83-9ff0-087b8725c081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:59.693463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee96d2-3f67-4d83-9ff0-087b8725c081 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:58:59.698019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:58:59.698693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:59.703970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:59.703970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] PATH_INFO: `/v3/projects/79bb43797d7c4ad5b66d4c3ec55bd558` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:59.703970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=79bb43797d7c4ad5b66d4c3ec55bd558)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:58:59.703970 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:58:59.854325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79bb43797d7c4ad5b66d4c3ec55bd558', 'request_id': 'req-526fa61a-800b-4e1e-82a6-c38a3180ea3f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:59.928017 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79bb43797d7c4ad5b66d4c3ec55bd558', 'request_id': 'req-526fa61a-800b-4e1e-82a6-c38a3180ea3f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:59.934516 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79bb43797d7c4ad5b66d4c3ec55bd558', 'request_id': 'req-526fa61a-800b-4e1e-82a6-c38a3180ea3f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:59.944771 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] The token cache is being invalidate because project 79bb43797d7c4ad5b66d4c3ec55bd558 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:58:59.946883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:59.946883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-526fa61a-800b-4e1e-82a6-c38a3180ea3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:58:59.947180 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1317/2651] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:58:59 2022] DELETE /identity/v3/projects/79bb43797d7c4ad5b66d4c3ec55bd558 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:58:59.952092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee3c5e-5ab4-4815-803b-e1b2bd37e671 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:58:59.952561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee3c5e-5ab4-4815-803b-e1b2bd37e671 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:58:59.952671 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee3c5e-5ab4-4815-803b-e1b2bd37e671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:58:59.972401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-a3ee3c5e-5ab4-4815-803b-e1b2bd37e671 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:58:59.973586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a3ee3c5e-5ab4-4815-803b-e1b2bd37e671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:58:59.990732 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:00.029444 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1335/2652] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:58:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:00.037625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cccb81-87ec-4bcb-b5fe-a41325ae9e28 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.037907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cccb81-87ec-4bcb-b5fe-a41325ae9e28 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.038181 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cccb81-87ec-4bcb-b5fe-a41325ae9e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.058906 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-29cccb81-87ec-4bcb-b5fe-a41325ae9e28 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:00.060340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-29cccb81-87ec-4bcb-b5fe-a41325ae9e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:00.069134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1318/2653] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:00.073464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee3c5e-5ab4-4815-803b-e1b2bd37e671 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:00.083190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee3c5e-5ab4-4815-803b-e1b2bd37e671 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:00.088744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ae0f-08a2-4944-879b-80299a44a918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:00.089341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ae0f-08a2-4944-879b-80299a44a918 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.089620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ae0f-08a2-4944-879b-80299a44a918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.089891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b3ae0f-08a2-4944-879b-80299a44a918 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.090536 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ae0f-08a2-4944-879b-80299a44a918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:59:00.090857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ae0f-08a2-4944-879b-80299a44a918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:00.092467 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b3ae0f-08a2-4944-879b-80299a44a918 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:00.104460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1336/2654] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:59:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:59:00.108580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cccb81-87ec-4bcb-b5fe-a41325ae9e28 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:00.114315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:00.120289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cccb81-87ec-4bcb-b5fe-a41325ae9e28 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:00.125665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e56b3-ac2a-48ce-b4f1-aa368ea8f125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:00.126403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e56b3-ac2a-48ce-b4f1-aa368ea8f125 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.126682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e56b3-ac2a-48ce-b4f1-aa368ea8f125 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.126982 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90e56b3-ac2a-48ce-b4f1-aa368ea8f125 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.127700 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e56b3-ac2a-48ce-b4f1-aa368ea8f125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:00.129597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90e56b3-ac2a-48ce-b4f1-aa368ea8f125 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:00.278111 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1319/2655] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:00 2022] POST /identity/v3/projects => generated 365 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:00.283223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ae0f-08a2-4944-879b-80299a44a918 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:00.292963 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b3ae0f-08a2-4944-879b-80299a44a918 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:00.347858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf88e4-a350-45dc-9624-68176e5ac5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:00.348459 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf88e4-a350-45dc-9624-68176e5ac5ea admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.348744 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf88e4-a350-45dc-9624-68176e5ac5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.349022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf88e4-a350-45dc-9624-68176e5ac5ea admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.349669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf88e4-a350-45dc-9624-68176e5ac5ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:00.351624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf88e4-a350-45dc-9624-68176e5ac5ea admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:00.442024 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1337/2656] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:00 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:00.446359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e56b3-ac2a-48ce-b4f1-aa368ea8f125 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:00.457035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90e56b3-ac2a-48ce-b4f1-aa368ea8f125 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:00.461607 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde8e53-2238-458c-a660-0e6472defc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:00.462203 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde8e53-2238-458c-a660-0e6472defc9e admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.462478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde8e53-2238-458c-a660-0e6472defc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.462748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde8e53-2238-458c-a660-0e6472defc9e admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.463389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde8e53-2238-458c-a660-0e6472defc9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:00.464991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde8e53-2238-458c-a660-0e6472defc9e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:00.475997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1320/2657] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:00.479842 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf88e4-a350-45dc-9624-68176e5ac5ea admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:00.489795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf88e4-a350-45dc-9624-68176e5ac5ea admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:00.494432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69ff33-416a-46e5-82d6-ab255c758867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:00.495015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ff33-416a-46e5-82d6-ab255c758867 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.495295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ff33-416a-46e5-82d6-ab255c758867 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.495595 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69ff33-416a-46e5-82d6-ab255c758867 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.496241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ff33-416a-46e5-82d6-ab255c758867 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:00.497805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec69ff33-416a-46e5-82d6-ab255c758867 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:00.508318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1338/2658] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:00.512445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde8e53-2238-458c-a660-0e6472defc9e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:00.522786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde8e53-2238-458c-a660-0e6472defc9e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:00.527650 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f83a-d53f-4d0f-a51f-bbee7bd0d3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:00.528291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f83a-d53f-4d0f-a51f-bbee7bd0d3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.528567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f83a-d53f-4d0f-a51f-bbee7bd0d3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.528839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb3f83a-d53f-4d0f-a51f-bbee7bd0d3f0 admin admin] PATH_INFO: `/v3/projects/68f013f38aea40098d098497bbff1b9b/users/cb14096d3cef4903ab2accb7268290a8/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.543734 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f83a-d53f-4d0f-a51f-bbee7bd0d3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f013f38aea40098d098497bbff1b9b, user_id=cb14096d3cef4903ab2accb7268290a8, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:00.546396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb3f83a-d53f-4d0f-a51f-bbee7bd0d3f0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:00.643415 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1321/2659] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:00 2022] PUT /identity/v3/projects/68f013f38aea40098d098497bbff1b9b/users/cb14096d3cef4903ab2accb7268290a8/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:00.654968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fed42d-c7a3-4d7e-bcf5-683edc75efe5 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.655260 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fed42d-c7a3-4d7e-bcf5-683edc75efe5 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.655558 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fed42d-c7a3-4d7e-bcf5-683edc75efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.682355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-40fed42d-c7a3-4d7e-bcf5-683edc75efe5 None None] MFA Rules not processed for user `cb14096d3cef4903ab2accb7268290a8`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:00.683599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-40fed42d-c7a3-4d7e-bcf5-683edc75efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:00.747069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1339/2660] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:00.757165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f83a-d53f-4d0f-a51f-bbee7bd0d3f0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:00.818534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb3f83a-d53f-4d0f-a51f-bbee7bd0d3f0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:00.823237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80e313-9200-4780-ae47-ff487a989551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:00.823879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80e313-9200-4780-ae47-ff487a989551 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.824162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80e313-9200-4780-ae47-ff487a989551 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.824444 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec80e313-9200-4780-ae47-ff487a989551 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.825086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80e313-9200-4780-ae47-ff487a989551 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:00.826971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec80e313-9200-4780-ae47-ff487a989551 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:00.923743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1322/2661] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:00 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:00.927763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fed42d-c7a3-4d7e-bcf5-683edc75efe5 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:00.938836 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fed42d-c7a3-4d7e-bcf5-683edc75efe5 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:00.950650 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:00.992667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac910-f0a4-4437-b622-14312711fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:00.993286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac910-f0a4-4437-b622-14312711fbdb admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:00.993462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac910-f0a4-4437-b622-14312711fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:00.993733 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ac910-f0a4-4437-b622-14312711fbdb admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:00.994357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ac910-f0a4-4437-b622-14312711fbdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:00.996332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ac910-f0a4-4437-b622-14312711fbdb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:01.082222 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1340/2662] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:00 2022] POST /identity/v3/users => generated 289 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:01.086272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80e313-9200-4780-ae47-ff487a989551 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:01.097032 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec80e313-9200-4780-ae47-ff487a989551 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:01.101664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c44af-cff3-41ad-b7ee-aa2886522b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:01.102257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c44af-cff3-41ad-b7ee-aa2886522b31 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:01.102544 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c44af-cff3-41ad-b7ee-aa2886522b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:01.102820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c44af-cff3-41ad-b7ee-aa2886522b31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:01.103489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c44af-cff3-41ad-b7ee-aa2886522b31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:01.105139 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c44af-cff3-41ad-b7ee-aa2886522b31 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:01.116249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1323/2663] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:01.120278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac910-f0a4-4437-b622-14312711fbdb admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:01.130519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ac910-f0a4-4437-b622-14312711fbdb admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:01.135585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e206b0-f297-4879-9927-e00bae80d72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:01.135801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e206b0-f297-4879-9927-e00bae80d72e admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:01.136087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e206b0-f297-4879-9927-e00bae80d72e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:01.136364 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e206b0-f297-4879-9927-e00bae80d72e admin admin] PATH_INFO: `/v3/projects/be4da8883a7e49f7942196610847a7f8/users/da8faa5376884387a88bdfac4b51db4e/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:01.150482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e206b0-f297-4879-9927-e00bae80d72e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4da8883a7e49f7942196610847a7f8, user_id=da8faa5376884387a88bdfac4b51db4e, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:01.153147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e206b0-f297-4879-9927-e00bae80d72e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:01.254516 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1341/2664] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:01 2022] PUT /identity/v3/projects/be4da8883a7e49f7942196610847a7f8/users/da8faa5376884387a88bdfac4b51db4e/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:01.258468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c44af-cff3-41ad-b7ee-aa2886522b31 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:01.268666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c44af-cff3-41ad-b7ee-aa2886522b31 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:01.323949 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74161cd6-2366-4b96-8bbf-37aa404dc7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:01.324548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161cd6-2366-4b96-8bbf-37aa404dc7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:01.324869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161cd6-2366-4b96-8bbf-37aa404dc7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:01.325143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74161cd6-2366-4b96-8bbf-37aa404dc7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:01.325783 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74161cd6-2366-4b96-8bbf-37aa404dc7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:01.327375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74161cd6-2366-4b96-8bbf-37aa404dc7e4 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:01.337330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1324/2665] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:01.341424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e206b0-f297-4879-9927-e00bae80d72e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:01.352056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e206b0-f297-4879-9927-e00bae80d72e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:01.356661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f55c6-1757-428d-b1a5-3daa44feca96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:01.357305 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f55c6-1757-428d-b1a5-3daa44feca96 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:01.357586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f55c6-1757-428d-b1a5-3daa44feca96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:01.357857 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88f55c6-1757-428d-b1a5-3daa44feca96 admin admin] PATH_INFO: `/v3/projects/be4da8883a7e49f7942196610847a7f8/users/da8faa5376884387a88bdfac4b51db4e/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:01.359792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f55c6-1757-428d-b1a5-3daa44feca96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be4da8883a7e49f7942196610847a7f8, user_id=da8faa5376884387a88bdfac4b51db4e, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:01.365033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88f55c6-1757-428d-b1a5-3daa44feca96 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:01.373206 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1342/2666] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:01 2022] PUT /identity/v3/projects/be4da8883a7e49f7942196610847a7f8/users/da8faa5376884387a88bdfac4b51db4e/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:01.385551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d657a-a28a-46aa-ba79-263a25d5f29f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:01.385835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d657a-a28a-46aa-ba79-263a25d5f29f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:01.386109 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d657a-a28a-46aa-ba79-263a25d5f29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:01.414753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-7f5d657a-a28a-46aa-ba79-263a25d5f29f None None] MFA Rules not processed for user `da8faa5376884387a88bdfac4b51db4e`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:01.415988 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-7f5d657a-a28a-46aa-ba79-263a25d5f29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:01.419913 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:01.483448 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1325/2667] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:01.495155 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f55c6-1757-428d-b1a5-3daa44feca96 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:01.496925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e88f55c6-1757-428d-b1a5-3daa44feca96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:01.554462 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88f55c6-1757-428d-b1a5-3daa44feca96 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:01.558056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c63fec-075f-42fb-92e8-9233a6f6a226 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:01.558677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63fec-075f-42fb-92e8-9233a6f6a226 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:01.558952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63fec-075f-42fb-92e8-9233a6f6a226 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:01.559220 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c63fec-075f-42fb-92e8-9233a6f6a226 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:01.568334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c63fec-075f-42fb-92e8-9233a6f6a226 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:01.569778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c63fec-075f-42fb-92e8-9233a6f6a226 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:01.580190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1343/2668] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:01.784114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d657a-a28a-46aa-ba79-263a25d5f29f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:01.793610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5d657a-a28a-46aa-ba79-263a25d5f29f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:01.797268 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de05127e-ebf6-4ed6-86c2-acd4ff332824 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:01.798176 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05127e-ebf6-4ed6-86c2-acd4ff332824 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:01.798952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05127e-ebf6-4ed6-86c2-acd4ff332824 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:01.799240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de05127e-ebf6-4ed6-86c2-acd4ff332824 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:01.859904 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05127e-ebf6-4ed6-86c2-acd4ff332824 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:01.861244 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de05127e-ebf6-4ed6-86c2-acd4ff332824 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:01.870597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1326/2669] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:01 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:05.433254 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c63fec-075f-42fb-92e8-9233a6f6a226 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:05.494460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c63fec-075f-42fb-92e8-9233a6f6a226 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:05.498914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:05.499553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:05.499833 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:05.500102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] PATH_INFO: `/v3/users/cb14096d3cef4903ab2accb7268290a8` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:05.501698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb14096d3cef4903ab2accb7268290a8)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:05.503611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:05.517619 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:05.677686 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb14096d3cef4903ab2accb7268290a8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:05.684551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb14096d3cef4903ab2accb7268290a8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:05.685218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb14096d3cef4903ab2accb7268290a8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:05.685835 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb14096d3cef4903ab2accb7268290a8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:05.761485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb14096d3cef4903ab2accb7268290a8'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:05.778751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1344/2670] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:05 2022] DELETE /identity/v3/users/cb14096d3cef4903ab2accb7268290a8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:05.783255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e52ccb-9741-4025-ae4c-f4ca7cf67bff None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:05.783800 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e52ccb-9741-4025-ae4c-f4ca7cf67bff None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:05.783901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e52ccb-9741-4025-ae4c-f4ca7cf67bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:05.803300 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-22e52ccb-9741-4025-ae4c-f4ca7cf67bff None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:05.804603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-22e52ccb-9741-4025-ae4c-f4ca7cf67bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:05.863879 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1327/2671] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:05.873756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:05.877002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:05.932122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0e067-00fd-4420-a395-73a1c7ff5de0 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:05.935676 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7671d-97a6-4e71-b086-928d05d7eecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:05.936272 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7671d-97a6-4e71-b086-928d05d7eecb service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:05.936554 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7671d-97a6-4e71-b086-928d05d7eecb service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:05.936828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e7671d-97a6-4e71-b086-928d05d7eecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:05.946259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7671d-97a6-4e71-b086-928d05d7eecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:05.947766 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e7671d-97a6-4e71-b086-928d05d7eecb service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:05.957097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1345/2672] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:06.386197 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e52ccb-9741-4025-ae4c-f4ca7cf67bff None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:06.387804 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-22e52ccb-9741-4025-ae4c-f4ca7cf67bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:06.403909 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e52ccb-9741-4025-ae4c-f4ca7cf67bff None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:06.409595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:06.410818 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:06.411442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:06.411903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] PATH_INFO: `/v3/projects/68f013f38aea40098d098497bbff1b9b` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:06.412963 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f013f38aea40098d098497bbff1b9b)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:06.415210 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:06.524461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:06.534601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f013f38aea40098d098497bbff1b9b', 'request_id': 'req-6948b9a8-e450-45f1-872d-caabbe8e745a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:06.630026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f013f38aea40098d098497bbff1b9b', 'request_id': 'req-6948b9a8-e450-45f1-872d-caabbe8e745a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:06.637034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f013f38aea40098d098497bbff1b9b', 'request_id': 'req-6948b9a8-e450-45f1-872d-caabbe8e745a'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:06.649937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] The token cache is being invalidate because project 68f013f38aea40098d098497bbff1b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:06.650234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:06.650898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:06.652424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1328/2673] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:06 2022] DELETE /identity/v3/projects/68f013f38aea40098d098497bbff1b9b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:06.656605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7671d-97a6-4e71-b086-928d05d7eecb service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:06.666502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e7671d-97a6-4e71-b086-928d05d7eecb service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:06.722581 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:06.723214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:06.723607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:06.723789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] PATH_INFO: `/v3/users/da8faa5376884387a88bdfac4b51db4e` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:06.724983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da8faa5376884387a88bdfac4b51db4e)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:06.726955 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:06.887707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:06.896583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da8faa5376884387a88bdfac4b51db4e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:06.903457 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da8faa5376884387a88bdfac4b51db4e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:06.904153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da8faa5376884387a88bdfac4b51db4e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:06.904770 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da8faa5376884387a88bdfac4b51db4e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:07.007047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ea3dfc87-75a7-4c99-b864-f931a5b94717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da8faa5376884387a88bdfac4b51db4e'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:07.025668 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1346/2674] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:06 2022] DELETE /identity/v3/users/da8faa5376884387a88bdfac4b51db4e => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:07.426435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:07.428076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:07.441142 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948b9a8-e450-45f1-872d-caabbe8e745a admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:07.498977 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:07.499657 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:07.499931 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:07.500208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] PATH_INFO: `/v3/projects/be4da8883a7e49f7942196610847a7f8` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:07.501332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be4da8883a7e49f7942196610847a7f8)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:07.503283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:07.619461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be4da8883a7e49f7942196610847a7f8', 'request_id': 'req-416949c1-fe10-4cf8-a947-d4fa329c979f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:07.721240 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be4da8883a7e49f7942196610847a7f8', 'request_id': 'req-416949c1-fe10-4cf8-a947-d4fa329c979f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:07.727884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be4da8883a7e49f7942196610847a7f8', 'request_id': 'req-416949c1-fe10-4cf8-a947-d4fa329c979f'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:07.738656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] The token cache is being invalidate because project be4da8883a7e49f7942196610847a7f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:07.738947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:07.739609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-416949c1-fe10-4cf8-a947-d4fa329c979f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:07.741096 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1329/2675] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:07 2022] DELETE /identity/v3/projects/be4da8883a7e49f7942196610847a7f8 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:07.747015 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa29e8-53e0-4f04-acdf-2dee8fa55940 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:07.747493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa29e8-53e0-4f04-acdf-2dee8fa55940 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:07.747731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfa29e8-53e0-4f04-acdf-2dee8fa55940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:07.767561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-3bfa29e8-53e0-4f04-acdf-2dee8fa55940 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:07.768761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-3bfa29e8-53e0-4f04-acdf-2dee8fa55940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:07.826727 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1347/2676] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:07.834640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353ebb0-a1fc-4007-9b31-d4bf8acdef3d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:07.834928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353ebb0-a1fc-4007-9b31-d4bf8acdef3d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:07.835209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0353ebb0-a1fc-4007-9b31-d4bf8acdef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:07.854753 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-0353ebb0-a1fc-4007-9b31-d4bf8acdef3d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:07.855975 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0353ebb0-a1fc-4007-9b31-d4bf8acdef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:07.864258 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1330/2677] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:07.868273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa29e8-53e0-4f04-acdf-2dee8fa55940 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:07.878301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfa29e8-53e0-4f04-acdf-2dee8fa55940 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:07.882877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a4e2-b4af-40c2-80ef-e66477c6fcb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:07.883495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a4e2-b4af-40c2-80ef-e66477c6fcb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:07.883806 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a4e2-b4af-40c2-80ef-e66477c6fcb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:07.884083 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b6a4e2-b4af-40c2-80ef-e66477c6fcb5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:07.884736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6a4e2-b4af-40c2-80ef-e66477c6fcb5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:59:07.885045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6a4e2-b4af-40c2-80ef-e66477c6fcb5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:07.886626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b6a4e2-b4af-40c2-80ef-e66477c6fcb5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:07.897975 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1348/2678] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:59:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:59:07.902072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353ebb0-a1fc-4007-9b31-d4bf8acdef3d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:07.911344 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0353ebb0-a1fc-4007-9b31-d4bf8acdef3d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:07.916124 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e3563-342e-45af-8a96-0226336dd876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:07.916731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e3563-342e-45af-8a96-0226336dd876 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:07.917014 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e3563-342e-45af-8a96-0226336dd876 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:07.917290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e3563-342e-45af-8a96-0226336dd876 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:07.917926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e3563-342e-45af-8a96-0226336dd876 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:07.919837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e3563-342e-45af-8a96-0226336dd876 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:08.010852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1331/2679] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:07 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:08.012207 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a4e2-b4af-40c2-80ef-e66477c6fcb5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:08.022271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b6a4e2-b4af-40c2-80ef-e66477c6fcb5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:08.078797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf172321-d446-487a-8fd2-2d07528e493d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:08.079396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf172321-d446-487a-8fd2-2d07528e493d admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:08.079704 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf172321-d446-487a-8fd2-2d07528e493d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:08.079979 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf172321-d446-487a-8fd2-2d07528e493d admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:08.080630 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf172321-d446-487a-8fd2-2d07528e493d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:08.082509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf172321-d446-487a-8fd2-2d07528e493d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:08.173271 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1349/2680] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:08 2022] POST /identity/v3/users => generated 294 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:08.177364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e3563-342e-45af-8a96-0226336dd876 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:08.187745 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e3563-342e-45af-8a96-0226336dd876 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:08.192443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcd326-9d34-4d43-9a5e-9d790b66cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:08.193038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcd326-9d34-4d43-9a5e-9d790b66cc31 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:08.193323 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcd326-9d34-4d43-9a5e-9d790b66cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:08.193602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dcd326-9d34-4d43-9a5e-9d790b66cc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:08.194283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcd326-9d34-4d43-9a5e-9d790b66cc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:08.195965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dcd326-9d34-4d43-9a5e-9d790b66cc31 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:08.205774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1332/2681] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:08.209567 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf172321-d446-487a-8fd2-2d07528e493d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:08.220230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf172321-d446-487a-8fd2-2d07528e493d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:08.225039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c3383-eece-4d85-930d-bdd90d1b8afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:08.225648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c3383-eece-4d85-930d-bdd90d1b8afc admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:08.225926 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c3383-eece-4d85-930d-bdd90d1b8afc admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:08.226194 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c3383-eece-4d85-930d-bdd90d1b8afc admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:08.226828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c3383-eece-4d85-930d-bdd90d1b8afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:08.228514 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c3383-eece-4d85-930d-bdd90d1b8afc admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:08.239446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1350/2682] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:08.243366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcd326-9d34-4d43-9a5e-9d790b66cc31 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:08.253366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dcd326-9d34-4d43-9a5e-9d790b66cc31 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:08.257938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e076c-46bd-4ed6-9221-22d6fab33757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:08.258579 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e076c-46bd-4ed6-9221-22d6fab33757 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:08.258864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e076c-46bd-4ed6-9221-22d6fab33757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:08.259144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e076c-46bd-4ed6-9221-22d6fab33757 admin admin] PATH_INFO: `/v3/projects/971b30e1040242ddaf6612ffaef03a33/users/f0f19b83e0944cf1a3bca99a74d13adf/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:08.269948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:08.273790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e076c-46bd-4ed6-9221-22d6fab33757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=971b30e1040242ddaf6612ffaef03a33, user_id=f0f19b83e0944cf1a3bca99a74d13adf, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:08.276491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19e076c-46bd-4ed6-9221-22d6fab33757 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:08.372446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1333/2683] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:08 2022] PUT /identity/v3/projects/971b30e1040242ddaf6612ffaef03a33/users/f0f19b83e0944cf1a3bca99a74d13adf/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:08.382889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b03081-5139-4916-a3b1-ba9adf8c036c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:08.383174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b03081-5139-4916-a3b1-ba9adf8c036c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:08.383450 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b03081-5139-4916-a3b1-ba9adf8c036c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:08.410477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-65b03081-5139-4916-a3b1-ba9adf8c036c None None] MFA Rules not processed for user `f0f19b83e0944cf1a3bca99a74d13adf`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:08.411751 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-65b03081-5139-4916-a3b1-ba9adf8c036c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:08.419673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:08.475120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1351/2684] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:08.479924 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e076c-46bd-4ed6-9221-22d6fab33757 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:08.541469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e076c-46bd-4ed6-9221-22d6fab33757 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:08.546038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dce84f-5bb4-4d5d-bf30-42792fac5513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:08.546641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dce84f-5bb4-4d5d-bf30-42792fac5513 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:08.546925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dce84f-5bb4-4d5d-bf30-42792fac5513 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:08.547200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dce84f-5bb4-4d5d-bf30-42792fac5513 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:08.547856 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dce84f-5bb4-4d5d-bf30-42792fac5513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:08.549743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dce84f-5bb4-4d5d-bf30-42792fac5513 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:08.744543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1334/2685] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:08 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:08.748742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b03081-5139-4916-a3b1-ba9adf8c036c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:08.760750 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b03081-5139-4916-a3b1-ba9adf8c036c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:08.817192 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172a490-135b-420e-9a54-7b3973f5cf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:08.817729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172a490-135b-420e-9a54-7b3973f5cf3d admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:08.818010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172a490-135b-420e-9a54-7b3973f5cf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:08.818283 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7172a490-135b-420e-9a54-7b3973f5cf3d admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:08.818929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172a490-135b-420e-9a54-7b3973f5cf3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:08.820864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7172a490-135b-420e-9a54-7b3973f5cf3d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:08.908001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1352/2686] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:08 2022] POST /identity/v3/users => generated 300 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:08.909312 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dce84f-5bb4-4d5d-bf30-42792fac5513 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:08.919683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dce84f-5bb4-4d5d-bf30-42792fac5513 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:08.924781 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1d3ef-7e5d-4b00-80ec-0d78c227977e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:08.925742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d3ef-7e5d-4b00-80ec-0d78c227977e admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:08.925742 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d3ef-7e5d-4b00-80ec-0d78c227977e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:08.925986 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1d3ef-7e5d-4b00-80ec-0d78c227977e admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:08.926538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1d3ef-7e5d-4b00-80ec-0d78c227977e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:08.928167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a1d3ef-7e5d-4b00-80ec-0d78c227977e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:08.940051 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1335/2687] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:08.944604 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172a490-135b-420e-9a54-7b3973f5cf3d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:08.954726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7172a490-135b-420e-9a54-7b3973f5cf3d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:08.960933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b0b69-c57f-441a-9db7-9095751db00a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:08.961673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0b69-c57f-441a-9db7-9095751db00a admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:08.961962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0b69-c57f-441a-9db7-9095751db00a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:08.962235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9b0b69-c57f-441a-9db7-9095751db00a admin admin] PATH_INFO: `/v3/projects/0359005179f540d19b08a723a7f0e7bc/users/d0757eef9e92477dbddf9f2a16f35478/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:08.977442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b0b69-c57f-441a-9db7-9095751db00a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0359005179f540d19b08a723a7f0e7bc, user_id=d0757eef9e92477dbddf9f2a16f35478, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:08.980121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9b0b69-c57f-441a-9db7-9095751db00a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:09.057413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1353/2688] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:08 2022] PUT /identity/v3/projects/0359005179f540d19b08a723a7f0e7bc/users/d0757eef9e92477dbddf9f2a16f35478/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:09.061591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1d3ef-7e5d-4b00-80ec-0d78c227977e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:09.072491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1d3ef-7e5d-4b00-80ec-0d78c227977e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:09.135324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0adbe-7ece-44bd-aa13-6834c6533928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:09.135964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0adbe-7ece-44bd-aa13-6834c6533928 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:09.136241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0adbe-7ece-44bd-aa13-6834c6533928 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:09.136547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0adbe-7ece-44bd-aa13-6834c6533928 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:09.137196 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0adbe-7ece-44bd-aa13-6834c6533928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:09.138947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0adbe-7ece-44bd-aa13-6834c6533928 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:09.149166 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1336/2689] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:09 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:09.153488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b0b69-c57f-441a-9db7-9095751db00a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:09.164074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9b0b69-c57f-441a-9db7-9095751db00a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:09.169799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473af90-b98e-4a77-92e5-fa540bd8de93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:09.170889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473af90-b98e-4a77-92e5-fa540bd8de93 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:09.171172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473af90-b98e-4a77-92e5-fa540bd8de93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:09.171441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473af90-b98e-4a77-92e5-fa540bd8de93 admin admin] PATH_INFO: `/v3/projects/0359005179f540d19b08a723a7f0e7bc/users/d0757eef9e92477dbddf9f2a16f35478/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:09.173976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473af90-b98e-4a77-92e5-fa540bd8de93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0359005179f540d19b08a723a7f0e7bc, user_id=d0757eef9e92477dbddf9f2a16f35478, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:09.179557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473af90-b98e-4a77-92e5-fa540bd8de93 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:09.202088 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1354/2690] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:09 2022] PUT /identity/v3/projects/0359005179f540d19b08a723a7f0e7bc/users/d0757eef9e92477dbddf9f2a16f35478/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:09.203389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c5cd-ed40-4bca-bc93-ded8cbe982a0 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:09.203717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c5cd-ed40-4bca-bc93-ded8cbe982a0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:09.204004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c5cd-ed40-4bca-bc93-ded8cbe982a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:09.239953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-6af9c5cd-ed40-4bca-bc93-ded8cbe982a0 None None] MFA Rules not processed for user `d0757eef9e92477dbddf9f2a16f35478`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:09.241467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6af9c5cd-ed40-4bca-bc93-ded8cbe982a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:09.295618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:09.318597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1337/2691] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:09 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:09.331214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473af90-b98e-4a77-92e5-fa540bd8de93 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:09.332675 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1473af90-b98e-4a77-92e5-fa540bd8de93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:09.391242 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473af90-b98e-4a77-92e5-fa540bd8de93 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:09.395073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051684c5-254f-49e5-a15f-f7af6cb07afb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:09.395649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051684c5-254f-49e5-a15f-f7af6cb07afb service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:09.395935 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051684c5-254f-49e5-a15f-f7af6cb07afb service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:09.396210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051684c5-254f-49e5-a15f-f7af6cb07afb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:09.405621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051684c5-254f-49e5-a15f-f7af6cb07afb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:09.407670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051684c5-254f-49e5-a15f-f7af6cb07afb service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:09.417556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1355/2692] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:09 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:09.485489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9c5cd-ed40-4bca-bc93-ded8cbe982a0 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:09.549263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9c5cd-ed40-4bca-bc93-ded8cbe982a0 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:09.553724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:09.554336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:09.554612 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:09.554885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] PATH_INFO: `/v3/users/f0f19b83e0944cf1a3bca99a74d13adf` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:09.556045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0f19b83e0944cf1a3bca99a74d13adf)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:09.557947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:09.816925 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0f19b83e0944cf1a3bca99a74d13adf'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:09.822863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0f19b83e0944cf1a3bca99a74d13adf'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:09.823534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0f19b83e0944cf1a3bca99a74d13adf'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:09.824155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0f19b83e0944cf1a3bca99a74d13adf'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:09.903200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0f19b83e0944cf1a3bca99a74d13adf'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:09.920361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1338/2693] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:09 2022] DELETE /identity/v3/users/f0f19b83e0944cf1a3bca99a74d13adf => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:09.924822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915cd0b-e436-477b-bee0-6a6f75169a3d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:09.925290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915cd0b-e436-477b-bee0-6a6f75169a3d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:09.925389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1915cd0b-e436-477b-bee0-6a6f75169a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:09.933304 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:09.944607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-1915cd0b-e436-477b-bee0-6a6f75169a3d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:09.945788 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1915cd0b-e436-477b-bee0-6a6f75169a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:10.003014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1356/2694] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:10.012803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:10.014253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:10.071307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516b8e0c-eec3-4bb0-8038-7ca01ba1b224 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:10.074935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c196105-6944-48e4-a90c-60318e887e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:10.075567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c196105-6944-48e4-a90c-60318e887e98 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:10.075850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c196105-6944-48e4-a90c-60318e887e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:10.076123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c196105-6944-48e4-a90c-60318e887e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:10.085138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c196105-6944-48e4-a90c-60318e887e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:10.086554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c196105-6944-48e4-a90c-60318e887e98 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:10.096120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1339/2695] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:10.584858 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915cd0b-e436-477b-bee0-6a6f75169a3d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:10.586265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1915cd0b-e436-477b-bee0-6a6f75169a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:10.603033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1915cd0b-e436-477b-bee0-6a6f75169a3d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:10.608288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:10.608950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:10.609783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:10.610108 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] PATH_INFO: `/v3/projects/971b30e1040242ddaf6612ffaef03a33` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:10.611247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] RBAC: Authorizing `identity:delete_project(project_id=971b30e1040242ddaf6612ffaef03a33)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:10.613318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:10.714938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '971b30e1040242ddaf6612ffaef03a33', 'request_id': 'req-96cea523-e03a-448d-bf3d-eed5792fe34c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:10.794879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '971b30e1040242ddaf6612ffaef03a33', 'request_id': 'req-96cea523-e03a-448d-bf3d-eed5792fe34c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:10.801579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '971b30e1040242ddaf6612ffaef03a33', 'request_id': 'req-96cea523-e03a-448d-bf3d-eed5792fe34c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:10.811976 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] The token cache is being invalidate because project 971b30e1040242ddaf6612ffaef03a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:10.812269 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:10.812946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-96cea523-e03a-448d-bf3d-eed5792fe34c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:10.814411 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1357/2696] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:10 2022] DELETE /identity/v3/projects/971b30e1040242ddaf6612ffaef03a33 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:10.818387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c196105-6944-48e4-a90c-60318e887e98 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:10.827853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c196105-6944-48e4-a90c-60318e887e98 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:10.832021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:10.883443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:10.884256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:10.884538 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:10.884816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] PATH_INFO: `/v3/users/d0757eef9e92477dbddf9f2a16f35478` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:10.885923 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0757eef9e92477dbddf9f2a16f35478)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:10.887871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:11.071310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0757eef9e92477dbddf9f2a16f35478'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:11.078363 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0757eef9e92477dbddf9f2a16f35478'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:11.079044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0757eef9e92477dbddf9f2a16f35478'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:11.079705 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0757eef9e92477dbddf9f2a16f35478'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:11.166518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0757eef9e92477dbddf9f2a16f35478'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:11.184955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1340/2697] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:10 2022] DELETE /identity/v3/users/d0757eef9e92477dbddf9f2a16f35478 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:11.592736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407712e-530d-4cac-b744-3defb7dd13ed None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:11.593588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407712e-530d-4cac-b744-3defb7dd13ed None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:11.597334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e407712e-530d-4cac-b744-3defb7dd13ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:11.613410 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-e407712e-530d-4cac-b744-3defb7dd13ed None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:11.614600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e407712e-530d-4cac-b744-3defb7dd13ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:11.643231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:11.643231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:11.672635 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1358/2698] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 08:59:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:11.721601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0b809-4100-4e36-9dff-cbf2fc4297eb admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:11.726333 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:11.726959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:11.727236 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:11.727529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] PATH_INFO: `/v3/projects/0359005179f540d19b08a723a7f0e7bc` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:11.728640 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0359005179f540d19b08a723a7f0e7bc)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:11.730518 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:11.883425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:11.890420 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407712e-530d-4cac-b744-3defb7dd13ed None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:11.892494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-e407712e-530d-4cac-b744-3defb7dd13ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:11.900001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0359005179f540d19b08a723a7f0e7bc', 'request_id': 'req-052ff644-6c6d-4a0b-83d4-9f744b10dd96'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:11.926004 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:11.959583 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e407712e-530d-4cac-b744-3defb7dd13ed None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:11.987831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0359005179f540d19b08a723a7f0e7bc', 'request_id': 'req-052ff644-6c6d-4a0b-83d4-9f744b10dd96'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:11.994388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0359005179f540d19b08a723a7f0e7bc', 'request_id': 'req-052ff644-6c6d-4a0b-83d4-9f744b10dd96'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:12.005463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] The token cache is being invalidate because project 0359005179f540d19b08a723a7f0e7bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:12.005754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:12.006399 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-052ff644-6c6d-4a0b-83d4-9f744b10dd96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:12.008200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1341/2699] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:11 2022] DELETE /identity/v3/projects/0359005179f540d19b08a723a7f0e7bc => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:12.012861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eefe6-3417-452e-b60e-45853dd7bc9f None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.013144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eefe6-3417-452e-b60e-45853dd7bc9f None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.013421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60eefe6-3417-452e-b60e-45853dd7bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.022914 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c924c8-7909-4646-8be8-44cf8293e67b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:12.023986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c924c8-7909-4646-8be8-44cf8293e67b service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.024298 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c924c8-7909-4646-8be8-44cf8293e67b service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.024575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c924c8-7909-4646-8be8-44cf8293e67b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.026383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-c6c924c8-7909-4646-8be8-44cf8293e67b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:12.034619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a60eefe6-3417-452e-b60e-45853dd7bc9f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:12.039496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a60eefe6-3417-452e-b60e-45853dd7bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:12.083301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c924c8-7909-4646-8be8-44cf8293e67b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:12.085000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c924c8-7909-4646-8be8-44cf8293e67b service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:12.094176 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1359/2700] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 04 08:59:12.097721 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1342/2701] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:12.105003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd516c99-61f5-4467-a54e-e61f819fa54a None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.105291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd516c99-61f5-4467-a54e-e61f819fa54a None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.105705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd516c99-61f5-4467-a54e-e61f819fa54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.128085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-bd516c99-61f5-4467-a54e-e61f819fa54a None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:12.129278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bd516c99-61f5-4467-a54e-e61f819fa54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:12.137216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1360/2702] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:12.142127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eefe6-3417-452e-b60e-45853dd7bc9f None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:12.152180 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60eefe6-3417-452e-b60e-45853dd7bc9f None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:12.156952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3575d-97df-4a4e-adae-dc1c29490d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:12.157551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3575d-97df-4a4e-adae-dc1c29490d8f admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.157861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3575d-97df-4a4e-adae-dc1c29490d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.158167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a3575d-97df-4a4e-adae-dc1c29490d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.158785 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3575d-97df-4a4e-adae-dc1c29490d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:59:12.159087 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3575d-97df-4a4e-adae-dc1c29490d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:12.160717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a3575d-97df-4a4e-adae-dc1c29490d8f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:12.172237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1343/2703] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:59:12.176507 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd516c99-61f5-4467-a54e-e61f819fa54a None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:12.185874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd516c99-61f5-4467-a54e-e61f819fa54a None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:12.191055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42b0bc-9995-4ada-bd20-a9255cb02e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:12.191716 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42b0bc-9995-4ada-bd20-a9255cb02e99 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.192022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42b0bc-9995-4ada-bd20-a9255cb02e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.192293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42b0bc-9995-4ada-bd20-a9255cb02e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.192924 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42b0bc-9995-4ada-bd20-a9255cb02e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:12.194796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42b0bc-9995-4ada-bd20-a9255cb02e99 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:12.344895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1361/2704] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:12 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:12.349097 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3575d-97df-4a4e-adae-dc1c29490d8f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:12.358919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a3575d-97df-4a4e-adae-dc1c29490d8f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:12.415273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39235c-e019-432d-ab53-ad4fff5d380f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:12.415871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39235c-e019-432d-ab53-ad4fff5d380f admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.416173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39235c-e019-432d-ab53-ad4fff5d380f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.416449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea39235c-e019-432d-ab53-ad4fff5d380f admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.417080 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39235c-e019-432d-ab53-ad4fff5d380f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:12.419566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea39235c-e019-432d-ab53-ad4fff5d380f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:12.513946 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1344/2705] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:12 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:12.518489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42b0bc-9995-4ada-bd20-a9255cb02e99 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:12.528723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42b0bc-9995-4ada-bd20-a9255cb02e99 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:12.534045 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d302-0f91-4b86-81c0-c7ba86fe0947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:12.534631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d302-0f91-4b86-81c0-c7ba86fe0947 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.534911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d302-0f91-4b86-81c0-c7ba86fe0947 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.535225 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090d302-0f91-4b86-81c0-c7ba86fe0947 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.535915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090d302-0f91-4b86-81c0-c7ba86fe0947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:12.537485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e090d302-0f91-4b86-81c0-c7ba86fe0947 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:12.548105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1362/2706] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:12.552163 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39235c-e019-432d-ab53-ad4fff5d380f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:12.562033 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea39235c-e019-432d-ab53-ad4fff5d380f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:12.566683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f77bce8-515b-43cf-bdc3-88fb77409827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:12.567267 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77bce8-515b-43cf-bdc3-88fb77409827 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.567690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77bce8-515b-43cf-bdc3-88fb77409827 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.567966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f77bce8-515b-43cf-bdc3-88fb77409827 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.568609 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77bce8-515b-43cf-bdc3-88fb77409827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:12.570229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f77bce8-515b-43cf-bdc3-88fb77409827 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:12.583601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1345/2707] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:12.587773 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d302-0f91-4b86-81c0-c7ba86fe0947 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:12.598966 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090d302-0f91-4b86-81c0-c7ba86fe0947 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:12.603762 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecd113-65cc-4ada-ad3c-b3e1e03c600d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:12.607728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd113-65cc-4ada-ad3c-b3e1e03c600d admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.607728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd113-65cc-4ada-ad3c-b3e1e03c600d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.607728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ecd113-65cc-4ada-ad3c-b3e1e03c600d admin admin] PATH_INFO: `/v3/projects/1ee1ae8f7e9144a9a5a3ba2eff5c5493/users/cbde431478074c7c94e60d430b194bfd/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.620054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecd113-65cc-4ada-ad3c-b3e1e03c600d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee1ae8f7e9144a9a5a3ba2eff5c5493, user_id=cbde431478074c7c94e60d430b194bfd, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:12.622773 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ecd113-65cc-4ada-ad3c-b3e1e03c600d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:12.718533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1363/2708] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:12 2022] PUT /identity/v3/projects/1ee1ae8f7e9144a9a5a3ba2eff5c5493/users/cbde431478074c7c94e60d430b194bfd/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:12.720751 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe603d68-2feb-475c-a77b-b1dc290b775a None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.721156 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe603d68-2feb-475c-a77b-b1dc290b775a None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.721496 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe603d68-2feb-475c-a77b-b1dc290b775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.751062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-fe603d68-2feb-475c-a77b-b1dc290b775a None None] MFA Rules not processed for user `cbde431478074c7c94e60d430b194bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:12.752301 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-fe603d68-2feb-475c-a77b-b1dc290b775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:12.761913 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:12.823859 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1346/2709] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:12.835440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecd113-65cc-4ada-ad3c-b3e1e03c600d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:12.837384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-95ecd113-65cc-4ada-ad3c-b3e1e03c600d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:12.854601 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:12.901747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ecd113-65cc-4ada-ad3c-b3e1e03c600d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:12.905556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6e7f2-76d1-4f8c-9ab6-e8334f5f91ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:12.906262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6e7f2-76d1-4f8c-9ab6-e8334f5f91ca service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:12.906617 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6e7f2-76d1-4f8c-9ab6-e8334f5f91ca service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:12.906916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6e7f2-76d1-4f8c-9ab6-e8334f5f91ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:12.915738 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6e7f2-76d1-4f8c-9ab6-e8334f5f91ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:12.917255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d6e7f2-76d1-4f8c-9ab6-e8334f5f91ca service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:12.926332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1364/2710] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:20.263426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe603d68-2feb-475c-a77b-b1dc290b775a None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:20.340818 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe603d68-2feb-475c-a77b-b1dc290b775a None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:20.345498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:20.346155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:20.346421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:20.346697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] PATH_INFO: `/v3/users/cbde431478074c7c94e60d430b194bfd` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:20.347855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbde431478074c7c94e60d430b194bfd)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:20.349767 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:20.543492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbde431478074c7c94e60d430b194bfd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:20.550958 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbde431478074c7c94e60d430b194bfd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:20.551634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbde431478074c7c94e60d430b194bfd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:20.552275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbde431478074c7c94e60d430b194bfd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:20.594337 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6e7f2-76d1-4f8c-9ab6-e8334f5f91ca service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:20.596095 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a2d6e7f2-76d1-4f8c-9ab6-e8334f5f91ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:20.610741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d6e7f2-76d1-4f8c-9ab6-e8334f5f91ca service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:20.615295 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:20.620680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:20.620680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:20.620680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] PATH_INFO: `/v3/users/a9adcdf31ad04666970949db298e3aff` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:20.620680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9adcdf31ad04666970949db298e3aff)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:20.620680 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:20.638998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-bb323246-fd51-4848-9a7e-9a14863d78e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbde431478074c7c94e60d430b194bfd'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:20.657665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1347/2711] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:20 2022] DELETE /identity/v3/users/cbde431478074c7c94e60d430b194bfd => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:20.662029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f894cc-cb26-4f9d-85f5-e4e0b85c2b49 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:20.662313 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f894cc-cb26-4f9d-85f5-e4e0b85c2b49 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:20.662589 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f894cc-cb26-4f9d-85f5-e4e0b85c2b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:20.681340 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f5f894cc-cb26-4f9d-85f5-e4e0b85c2b49 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:20.682534 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f5f894cc-cb26-4f9d-85f5-e4e0b85c2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:20.708165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:20.740416 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1348/2712] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:20.750758 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f894cc-cb26-4f9d-85f5-e4e0b85c2b49 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:20.752229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f5f894cc-cb26-4f9d-85f5-e4e0b85c2b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:20.806092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f894cc-cb26-4f9d-85f5-e4e0b85c2b49 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:20.809729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380208b-39ff-4926-858e-4a7e1381b3ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:20.810330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380208b-39ff-4926-858e-4a7e1381b3ae service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:20.810603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380208b-39ff-4926-858e-4a7e1381b3ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:20.810874 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380208b-39ff-4926-858e-4a7e1381b3ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:20.820855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380208b-39ff-4926-858e-4a7e1381b3ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:20.822262 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4380208b-39ff-4926-858e-4a7e1381b3ae service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:20.833286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1349/2713] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:59:20.883499 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9adcdf31ad04666970949db298e3aff'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:20.891056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9adcdf31ad04666970949db298e3aff'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:20.891765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9adcdf31ad04666970949db298e3aff'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:20.892376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9adcdf31ad04666970949db298e3aff'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:20.988002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9adcdf31ad04666970949db298e3aff'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.012566 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1365/2714] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:20 2022] DELETE /identity/v3/users/a9adcdf31ad04666970949db298e3aff => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:21.228436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380208b-39ff-4926-858e-4a7e1381b3ae service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:21.228436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4380208b-39ff-4926-858e-4a7e1381b3ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:21.237670 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4380208b-39ff-4926-858e-4a7e1381b3ae service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:21.261455 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:21.263059 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:21.300837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:21.301481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:21.301763 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:21.302046 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] PATH_INFO: `/v3/projects/1ee1ae8f7e9144a9a5a3ba2eff5c5493` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:21.303207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee1ae8f7e9144a9a5a3ba2eff5c5493)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:21.305310 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:21.335001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c01614-7bd1-4a26-8c68-d8b4f15d9b3a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:21.339618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:21.340248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:21.340781 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:21.341052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] PATH_INFO: `/v3/projects/9c12a37350bb47aca068cb39fe807d0a` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:21.342290 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c12a37350bb47aca068cb39fe807d0a)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:21.344793 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:21.417349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee1ae8f7e9144a9a5a3ba2eff5c5493', 'request_id': 'req-fcd44325-ce7c-4509-9ddb-c417a594a2b7'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.489447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:21.502510 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c12a37350bb47aca068cb39fe807d0a', 'request_id': 'req-d8857966-d9e8-4952-aba0-0482fb3c6b38'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.513432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee1ae8f7e9144a9a5a3ba2eff5c5493', 'request_id': 'req-fcd44325-ce7c-4509-9ddb-c417a594a2b7'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.519945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee1ae8f7e9144a9a5a3ba2eff5c5493', 'request_id': 'req-fcd44325-ce7c-4509-9ddb-c417a594a2b7'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.530561 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] The token cache is being invalidate because project 1ee1ae8f7e9144a9a5a3ba2eff5c5493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:21.530851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.531493 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-fcd44325-ce7c-4509-9ddb-c417a594a2b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.533019 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1350/2715] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:21 2022] DELETE /identity/v3/projects/1ee1ae8f7e9144a9a5a3ba2eff5c5493 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:21.537668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecdcd4-f02b-4bab-a396-bc0ed60223b8 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:21.537976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecdcd4-f02b-4bab-a396-bc0ed60223b8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:21.538254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ecdcd4-f02b-4bab-a396-bc0ed60223b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:21.547029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:21.558843 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-c2ecdcd4-f02b-4bab-a396-bc0ed60223b8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:21.562601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c2ecdcd4-f02b-4bab-a396-bc0ed60223b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:21.619810 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1351/2716] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:21.622006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c12a37350bb47aca068cb39fe807d0a', 'request_id': 'req-d8857966-d9e8-4952-aba0-0482fb3c6b38'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.627527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6baeae-55e1-46b6-ace0-26f67ed7997b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:21.631006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6baeae-55e1-46b6-ace0-26f67ed7997b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:21.631006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6baeae-55e1-46b6-ace0-26f67ed7997b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:21.631219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c12a37350bb47aca068cb39fe807d0a', 'request_id': 'req-d8857966-d9e8-4952-aba0-0482fb3c6b38'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.639441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] The token cache is being invalidate because project 9c12a37350bb47aca068cb39fe807d0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:21.640049 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.640698 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.642511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1366/2717] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:21 2022] DELETE /identity/v3/projects/9c12a37350bb47aca068cb39fe807d0a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:21.646221 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:21.647568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:21.648489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-5a6baeae-55e1-46b6-ace0-26f67ed7997b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:21.649665 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5a6baeae-55e1-46b6-ace0-26f67ed7997b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:21.657948 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1352/2718] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:21.660703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8857966-d9e8-4952-aba0-0482fb3c6b38 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:21.662752 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6baeae-55e1-46b6-ace0-26f67ed7997b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:21.665424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:21.666050 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:21.666331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:21.666605 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] PATH_INFO: `/v3/users/54e9e00188784138ab0e6bc2f99c74b9` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:21.667759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] RBAC: Authorizing `identity:delete_user(user_id=54e9e00188784138ab0e6bc2f99c74b9)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:21.669662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:21.672446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6baeae-55e1-46b6-ace0-26f67ed7997b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:21.677208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0425324-172e-4786-9b60-3775a129c776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:21.683129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0425324-172e-4786-9b60-3775a129c776 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:21.683129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0425324-172e-4786-9b60-3775a129c776 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:21.683129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0425324-172e-4786-9b60-3775a129c776 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:21.683129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0425324-172e-4786-9b60-3775a129c776 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:59:21.683129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0425324-172e-4786-9b60-3775a129c776 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:21.683129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0425324-172e-4786-9b60-3775a129c776 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:21.692432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1353/2719] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:59:21.696722 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0425324-172e-4786-9b60-3775a129c776 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:21.706123 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0425324-172e-4786-9b60-3775a129c776 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:21.710723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9062bc2-fde7-46ab-950d-b64e50b2280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:21.711290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9062bc2-fde7-46ab-950d-b64e50b2280e admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:21.711602 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9062bc2-fde7-46ab-950d-b64e50b2280e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:21.711877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9062bc2-fde7-46ab-950d-b64e50b2280e admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:21.712487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9062bc2-fde7-46ab-950d-b64e50b2280e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:21.714356 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9062bc2-fde7-46ab-950d-b64e50b2280e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:21.874461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1354/2720] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:21 2022] POST /identity/v3/projects => generated 375 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:21.882149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9062bc2-fde7-46ab-950d-b64e50b2280e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:21.910951 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54e9e00188784138ab0e6bc2f99c74b9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.918424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54e9e00188784138ab0e6bc2f99c74b9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.919102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54e9e00188784138ab0e6bc2f99c74b9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.919743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54e9e00188784138ab0e6bc2f99c74b9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:21.943888 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9062bc2-fde7-46ab-950d-b64e50b2280e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:21.948528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9835a-0145-40ac-bbe5-29a1ba3da9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:21.949129 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9835a-0145-40ac-bbe5-29a1ba3da9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:21.949408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9835a-0145-40ac-bbe5-29a1ba3da9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:21.949680 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9835a-0145-40ac-bbe5-29a1ba3da9e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:21.950304 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9835a-0145-40ac-bbe5-29a1ba3da9e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:21.952776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9835a-0145-40ac-bbe5-29a1ba3da9e1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:21.998441 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54e9e00188784138ab0e6bc2f99c74b9'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:22.024780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1367/2721] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:21 2022] DELETE /identity/v3/users/54e9e00188784138ab0e6bc2f99c74b9 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:22.036364 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1355/2722] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:21 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:22.037656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.039074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:22.106911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2232f7-4396-4abd-8ef7-91ee29153dab admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.111739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a973ab1-a240-48f7-b0f6-bd1ea19fe512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.112349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a973ab1-a240-48f7-b0f6-bd1ea19fe512 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.112654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a973ab1-a240-48f7-b0f6-bd1ea19fe512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.112923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a973ab1-a240-48f7-b0f6-bd1ea19fe512 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.113563 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a973ab1-a240-48f7-b0f6-bd1ea19fe512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.115152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a973ab1-a240-48f7-b0f6-bd1ea19fe512 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.126336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1368/2723] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:22.130346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9835a-0145-40ac-bbe5-29a1ba3da9e1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.141001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9835a-0145-40ac-bbe5-29a1ba3da9e1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.145921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace272d-efbc-4db8-b12c-23bf6439a2e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.146525 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace272d-efbc-4db8-b12c-23bf6439a2e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.146805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace272d-efbc-4db8-b12c-23bf6439a2e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.147077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aace272d-efbc-4db8-b12c-23bf6439a2e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.148286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace272d-efbc-4db8-b12c-23bf6439a2e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.149857 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aace272d-efbc-4db8-b12c-23bf6439a2e1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.164690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1356/2724] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:22.165852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a973ab1-a240-48f7-b0f6-bd1ea19fe512 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.176126 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a973ab1-a240-48f7-b0f6-bd1ea19fe512 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.180860 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb81010-53be-4e88-9ccd-6c84bdbb1356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.181512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb81010-53be-4e88-9ccd-6c84bdbb1356 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.181795 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb81010-53be-4e88-9ccd-6c84bdbb1356 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.182072 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb81010-53be-4e88-9ccd-6c84bdbb1356 admin admin] PATH_INFO: `/v3/projects/5afe89503b454299900ac5a3b4f82902/users/950125353fc94932bea30df3ba35b18a/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.197136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb81010-53be-4e88-9ccd-6c84bdbb1356 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afe89503b454299900ac5a3b4f82902, user_id=950125353fc94932bea30df3ba35b18a, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.199807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb81010-53be-4e88-9ccd-6c84bdbb1356 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.301796 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace272d-efbc-4db8-b12c-23bf6439a2e1 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.303658 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-aace272d-efbc-4db8-b12c-23bf6439a2e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:22.324870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1369/2725] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:22 2022] PUT /identity/v3/projects/5afe89503b454299900ac5a3b4f82902/users/950125353fc94932bea30df3ba35b18a/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:22.325000 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aace272d-efbc-4db8-b12c-23bf6439a2e1 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.326504 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7574e-6d97-4d3c-85f6-5ecf9335c8eb None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.326853 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7574e-6d97-4d3c-85f6-5ecf9335c8eb None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.327787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7574e-6d97-4d3c-85f6-5ecf9335c8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.336117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:22.357977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-80e7574e-6d97-4d3c-85f6-5ecf9335c8eb None None] MFA Rules not processed for user `950125353fc94932bea30df3ba35b18a`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:22.359352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-80e7574e-6d97-4d3c-85f6-5ecf9335c8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:22.361755 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:22.378817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.379382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.379690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.379971 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] PATH_INFO: `/v3/projects/0a38652fd093491bb47ba9784c3ec56e` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.381093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a38652fd093491bb47ba9784c3ec56e)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.382989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.423203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1370/2726] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:22.427556 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7574e-6d97-4d3c-85f6-5ecf9335c8eb None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.437737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7574e-6d97-4d3c-85f6-5ecf9335c8eb None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.442195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85919255-f57d-41a8-9edc-468acb3913af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.442756 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85919255-f57d-41a8-9edc-468acb3913af admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.443037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85919255-f57d-41a8-9edc-468acb3913af admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.443310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85919255-f57d-41a8-9edc-468acb3913af admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.443971 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85919255-f57d-41a8-9edc-468acb3913af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.445827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85919255-f57d-41a8-9edc-468acb3913af admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.519039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a38652fd093491bb47ba9784c3ec56e', 'request_id': 'req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:22.536421 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1371/2727] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:22 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:22.540350 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85919255-f57d-41a8-9edc-468acb3913af admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.599599 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85919255-f57d-41a8-9edc-468acb3913af admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.604203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a742-96a3-4e61-a676-1e595706a098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.604796 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a742-96a3-4e61-a676-1e595706a098 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.605076 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a742-96a3-4e61-a676-1e595706a098 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.605347 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f18a742-96a3-4e61-a676-1e595706a098 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.605968 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18a742-96a3-4e61-a676-1e595706a098 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.607960 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f18a742-96a3-4e61-a676-1e595706a098 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.609319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a38652fd093491bb47ba9784c3ec56e', 'request_id': 'req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:22.616491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a38652fd093491bb47ba9784c3ec56e', 'request_id': 'req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:22.627666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] The token cache is being invalidate because project 0a38652fd093491bb47ba9784c3ec56e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:22.630587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:22.630587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-94fa1abd-b3c5-46f1-97ce-5ddd03cf6445 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:22.630587 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1357/2728] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:22 2022] DELETE /identity/v3/projects/0a38652fd093491bb47ba9784c3ec56e => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:22.634782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a38d52-138a-4b5b-a05f-6a239bf113d0 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.635062 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a38d52-138a-4b5b-a05f-6a239bf113d0 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.635336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a38d52-138a-4b5b-a05f-6a239bf113d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.654878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-94a38d52-138a-4b5b-a05f-6a239bf113d0 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:22.656214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-94a38d52-138a-4b5b-a05f-6a239bf113d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:22.664192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1358/2729] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:22.671425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad6104-97c0-44c0-bb84-1a5eeb1cda0c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.671736 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad6104-97c0-44c0-bb84-1a5eeb1cda0c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.672018 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ad6104-97c0-44c0-bb84-1a5eeb1cda0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.684509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1372/2730] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:22 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:22.690691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a742-96a3-4e61-a676-1e595706a098 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.692327 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-4f18a742-96a3-4e61-a676-1e595706a098 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:22.692465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b9ad6104-97c0-44c0-bb84-1a5eeb1cda0c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:22.693520 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b9ad6104-97c0-44c0-bb84-1a5eeb1cda0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:22.701367 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1359/2731] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:22.705170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f18a742-96a3-4e61-a676-1e595706a098 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.705875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad6104-97c0-44c0-bb84-1a5eeb1cda0c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.710073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624ed76-1cd2-49c8-9ee5-9f2fb4e55fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.710681 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624ed76-1cd2-49c8-9ee5-9f2fb4e55fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.713227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624ed76-1cd2-49c8-9ee5-9f2fb4e55fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.713227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b624ed76-1cd2-49c8-9ee5-9f2fb4e55fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.713227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624ed76-1cd2-49c8-9ee5-9f2fb4e55fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.713572 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b624ed76-1cd2-49c8-9ee5-9f2fb4e55fa5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.714864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ad6104-97c0-44c0-bb84-1a5eeb1cda0c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.720815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e789cf0-e477-4aab-aa35-333170db54db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.721545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e789cf0-e477-4aab-aa35-333170db54db admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.721887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e789cf0-e477-4aab-aa35-333170db54db admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.722164 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e789cf0-e477-4aab-aa35-333170db54db admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.724029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e789cf0-e477-4aab-aa35-333170db54db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:59:22.724152 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1373/2732] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:59:22.724336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e789cf0-e477-4aab-aa35-333170db54db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.726036 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e789cf0-e477-4aab-aa35-333170db54db admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.728154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624ed76-1cd2-49c8-9ee5-9f2fb4e55fa5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.739442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b624ed76-1cd2-49c8-9ee5-9f2fb4e55fa5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.740831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1360/2733] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:59:22.744301 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0b1eb-2b16-4e42-a4d2-e82545789ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.744816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e789cf0-e477-4aab-aa35-333170db54db admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.745078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0b1eb-2b16-4e42-a4d2-e82545789ea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.745366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0b1eb-2b16-4e42-a4d2-e82545789ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.746953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda0b1eb-2b16-4e42-a4d2-e82545789ea5 admin admin] PATH_INFO: `/v3/projects/dd3270074180437292afba6e5b5b7854/users/ba62dadae0ce4d8dafbee3de75183e91/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.755710 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e789cf0-e477-4aab-aa35-333170db54db admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.760869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c3c7-502e-4a7f-9bf4-d76a8012c88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.765005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c3c7-502e-4a7f-9bf4-d76a8012c88d admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.765005 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c3c7-502e-4a7f-9bf4-d76a8012c88d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.765248 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0b1eb-2b16-4e42-a4d2-e82545789ea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3270074180437292afba6e5b5b7854, user_id=ba62dadae0ce4d8dafbee3de75183e91, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.765370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7c3c7-502e-4a7f-9bf4-d76a8012c88d admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.765370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c3c7-502e-4a7f-9bf4-d76a8012c88d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.765370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff7c3c7-502e-4a7f-9bf4-d76a8012c88d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.765626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda0b1eb-2b16-4e42-a4d2-e82545789ea5 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:22.891099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1374/2734] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:22 2022] PUT /identity/v3/projects/dd3270074180437292afba6e5b5b7854/users/ba62dadae0ce4d8dafbee3de75183e91/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:22.891099 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0b1eb-2b16-4e42-a4d2-e82545789ea5 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.914879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:22.921277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1361/2735] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:22 2022] POST /identity/v3/projects => generated 373 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:22.925433 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c3c7-502e-4a7f-9bf4-d76a8012c88d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:22.951497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda0b1eb-2b16-4e42-a4d2-e82545789ea5 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.987980 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff7c3c7-502e-4a7f-9bf4-d76a8012c88d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:22.992816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1aedf-9ebc-4a12-a81a-3e5e6f195760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:22.993380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1aedf-9ebc-4a12-a81a-3e5e6f195760 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:22.993661 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1aedf-9ebc-4a12-a81a-3e5e6f195760 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:22.993961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f1aedf-9ebc-4a12-a81a-3e5e6f195760 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:22.994619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1aedf-9ebc-4a12-a81a-3e5e6f195760 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:22.996564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f1aedf-9ebc-4a12-a81a-3e5e6f195760 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:23.007629 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25090f85-f6c2-448d-81d0-e1630982001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:23.008238 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25090f85-f6c2-448d-81d0-e1630982001b admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:23.008524 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25090f85-f6c2-448d-81d0-e1630982001b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:23.008825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25090f85-f6c2-448d-81d0-e1630982001b admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:23.009607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25090f85-f6c2-448d-81d0-e1630982001b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:23.011228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25090f85-f6c2-448d-81d0-e1630982001b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:23.021355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1375/2736] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:22 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:59:23.025529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25090f85-f6c2-448d-81d0-e1630982001b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:23.035922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25090f85-f6c2-448d-81d0-e1630982001b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:23.040656 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ce337-cec7-4f76-8a07-53b2a403b26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:23.041280 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ce337-cec7-4f76-8a07-53b2a403b26e admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:23.041562 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ce337-cec7-4f76-8a07-53b2a403b26e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:23.041838 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ce337-cec7-4f76-8a07-53b2a403b26e admin admin] PATH_INFO: `/v3/projects/dd3270074180437292afba6e5b5b7854/users/ba62dadae0ce4d8dafbee3de75183e91/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:23.043809 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ce337-cec7-4f76-8a07-53b2a403b26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd3270074180437292afba6e5b5b7854, user_id=ba62dadae0ce4d8dafbee3de75183e91, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:23.047182 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ce337-cec7-4f76-8a07-53b2a403b26e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:23.059493 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1376/2737] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:23 2022] PUT /identity/v3/projects/dd3270074180437292afba6e5b5b7854/users/ba62dadae0ce4d8dafbee3de75183e91/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:23.076561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf520c25-cfcb-4bf8-b3c7-bd4111bd8770 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:23.077646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf520c25-cfcb-4bf8-b3c7-bd4111bd8770 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:23.078092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf520c25-cfcb-4bf8-b3c7-bd4111bd8770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:23.107463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-cf520c25-cfcb-4bf8-b3c7-bd4111bd8770 None None] MFA Rules not processed for user `ba62dadae0ce4d8dafbee3de75183e91`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:23.108734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cf520c25-cfcb-4bf8-b3c7-bd4111bd8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:23.125330 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1362/2738] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:22 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:23.132378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1aedf-9ebc-4a12-a81a-3e5e6f195760 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:23.143938 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f1aedf-9ebc-4a12-a81a-3e5e6f195760 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:23.153430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:23.187393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1377/2739] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:23 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:23.198714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf520c25-cfcb-4bf8-b3c7-bd4111bd8770 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:23.200198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cf520c25-cfcb-4bf8-b3c7-bd4111bd8770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:23.208437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90821db-2ae2-496c-af51-68806fe0f185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:23.209158 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90821db-2ae2-496c-af51-68806fe0f185 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:23.209442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90821db-2ae2-496c-af51-68806fe0f185 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:23.209720 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90821db-2ae2-496c-af51-68806fe0f185 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:23.210562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90821db-2ae2-496c-af51-68806fe0f185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:23.212374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90821db-2ae2-496c-af51-68806fe0f185 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:23.224809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1363/2740] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:59:23.228926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90821db-2ae2-496c-af51-68806fe0f185 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:23.241830 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90821db-2ae2-496c-af51-68806fe0f185 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:23.246146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae61ec-98bc-4bba-b6df-0176325a2d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:23.246812 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae61ec-98bc-4bba-b6df-0176325a2d3c admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:23.247336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae61ec-98bc-4bba-b6df-0176325a2d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:23.247336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae61ec-98bc-4bba-b6df-0176325a2d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:23.248018 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae61ec-98bc-4bba-b6df-0176325a2d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:23.250152 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae61ec-98bc-4bba-b6df-0176325a2d3c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:23.258348 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf520c25-cfcb-4bf8-b3c7-bd4111bd8770 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:23.260061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1364/2741] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:23.262333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f412a175-4384-40e6-8455-fdab6a5c197b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:23.262939 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412a175-4384-40e6-8455-fdab6a5c197b service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:23.263228 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412a175-4384-40e6-8455-fdab6a5c197b service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:23.263521 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f412a175-4384-40e6-8455-fdab6a5c197b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:23.264370 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae61ec-98bc-4bba-b6df-0176325a2d3c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:23.265933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f412a175-4384-40e6-8455-fdab6a5c197b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:23.274427 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae61ec-98bc-4bba-b6df-0176325a2d3c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:23.279003 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cbed3-49c9-40d0-b884-fd82439cb8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:23.279844 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cbed3-49c9-40d0-b884-fd82439cb8ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:23.279999 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cbed3-49c9-40d0-b884-fd82439cb8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:23.280260 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90cbed3-49c9-40d0-b884-fd82439cb8ce admin admin] PATH_INFO: `/v3/projects/2e9f862941bd43c0a6de2d8bad2f3d2d/users/7fabfe9cbd604b2dac80959b5ee73880/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:23.293937 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:23.294728 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cbed3-49c9-40d0-b884-fd82439cb8ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e9f862941bd43c0a6de2d8bad2f3d2d, user_id=7fabfe9cbd604b2dac80959b5ee73880, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:23.297417 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90cbed3-49c9-40d0-b884-fd82439cb8ce admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:23.325310 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412a175-4384-40e6-8455-fdab6a5c197b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:23.326763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f412a175-4384-40e6-8455-fdab6a5c197b service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:23.336240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1378/2742] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:59:23.377076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1365/2743] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:23 2022] PUT /identity/v3/projects/2e9f862941bd43c0a6de2d8bad2f3d2d/users/7fabfe9cbd604b2dac80959b5ee73880/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:23.382167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff206fb6-1884-495e-ac4e-91e5cbbfac4e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:23.382463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff206fb6-1884-495e-ac4e-91e5cbbfac4e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:23.382741 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff206fb6-1884-495e-ac4e-91e5cbbfac4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:23.402739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ff206fb6-1884-495e-ac4e-91e5cbbfac4e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:23.404021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ff206fb6-1884-495e-ac4e-91e5cbbfac4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:23.468557 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1379/2744] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:23.478092 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cbed3-49c9-40d0-b884-fd82439cb8ce admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:23.479959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-c90cbed3-49c9-40d0-b884-fd82439cb8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:23.538621 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90cbed3-49c9-40d0-b884-fd82439cb8ce admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:23.542488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956cc71-90f8-4190-812e-e7cf55d0c59b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:23.543094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cc71-90f8-4190-812e-e7cf55d0c59b service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:23.543383 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cc71-90f8-4190-812e-e7cf55d0c59b service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:23.543686 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956cc71-90f8-4190-812e-e7cf55d0c59b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:23.553232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956cc71-90f8-4190-812e-e7cf55d0c59b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:23.554656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956cc71-90f8-4190-812e-e7cf55d0c59b service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:23.564190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1366/2745] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:26.399700 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff206fb6-1884-495e-ac4e-91e5cbbfac4e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:26.411203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff206fb6-1884-495e-ac4e-91e5cbbfac4e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:26.416692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:26.417777 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:26.418092 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:26.418368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] PATH_INFO: `/v3/users/950125353fc94932bea30df3ba35b18a` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:26.425419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=950125353fc94932bea30df3ba35b18a)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:26.427429 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:26.630419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '950125353fc94932bea30df3ba35b18a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:26.637826 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '950125353fc94932bea30df3ba35b18a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:26.657492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '950125353fc94932bea30df3ba35b18a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:26.657492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '950125353fc94932bea30df3ba35b18a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:26.729339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '950125353fc94932bea30df3ba35b18a'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:26.753828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1380/2746] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:26 2022] DELETE /identity/v3/users/950125353fc94932bea30df3ba35b18a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:26.758190 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42c70b-4a2f-417b-9b98-85e8769b4716 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:26.759217 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42c70b-4a2f-417b-9b98-85e8769b4716 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:26.759677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42c70b-4a2f-417b-9b98-85e8769b4716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:26.782419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-df42c70b-4a2f-417b-9b98-85e8769b4716 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:26.783673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-df42c70b-4a2f-417b-9b98-85e8769b4716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:26.871541 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1367/2747] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:26.880560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:26.882012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:26.895598 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:26.980877 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627613de-4ccd-4760-9e07-09580932ab11 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:26.986197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f052cd-3f5a-479a-8f76-ed54c02347ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:26.987098 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f052cd-3f5a-479a-8f76-ed54c02347ca service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:26.987703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f052cd-3f5a-479a-8f76-ed54c02347ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:26.988146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f052cd-3f5a-479a-8f76-ed54c02347ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:27.003250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f052cd-3f5a-479a-8f76-ed54c02347ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:27.003250 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f052cd-3f5a-479a-8f76-ed54c02347ca service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:27.013403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1381/2748] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:27.521716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42c70b-4a2f-417b-9b98-85e8769b4716 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:27.523355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-df42c70b-4a2f-417b-9b98-85e8769b4716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:27.543468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42c70b-4a2f-417b-9b98-85e8769b4716 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:27.548227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:27.548861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:27.549138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:27.549414 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] PATH_INFO: `/v3/projects/5afe89503b454299900ac5a3b4f82902` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:27.550629 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afe89503b454299900ac5a3b4f82902)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:27.552629 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:27.564614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:27.681290 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afe89503b454299900ac5a3b4f82902', 'request_id': 'req-516d7536-bc93-4d84-bc60-e3e436ded158'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:27.752479 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afe89503b454299900ac5a3b4f82902', 'request_id': 'req-516d7536-bc93-4d84-bc60-e3e436ded158'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:27.764507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afe89503b454299900ac5a3b4f82902', 'request_id': 'req-516d7536-bc93-4d84-bc60-e3e436ded158'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:27.771147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] The token cache is being invalidate because project 5afe89503b454299900ac5a3b4f82902 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:27.771623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:27.772277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:27.773789 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1368/2749] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:27 2022] DELETE /identity/v3/projects/5afe89503b454299900ac5a3b4f82902 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:27.777748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f052cd-3f5a-479a-8f76-ed54c02347ca service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:27.787419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f052cd-3f5a-479a-8f76-ed54c02347ca service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:27.842769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:27.843383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:27.843702 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:27.843977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] PATH_INFO: `/v3/users/ba62dadae0ce4d8dafbee3de75183e91` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:27.845071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba62dadae0ce4d8dafbee3de75183e91)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:27.846958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:28.056665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba62dadae0ce4d8dafbee3de75183e91'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:28.064512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba62dadae0ce4d8dafbee3de75183e91'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:28.065365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba62dadae0ce4d8dafbee3de75183e91'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:28.065969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba62dadae0ce4d8dafbee3de75183e91'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:28.187240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-c9fcd3e0-f344-4062-8fba-55e981517172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba62dadae0ce4d8dafbee3de75183e91'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:28.211492 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1382/2750] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:27 2022] DELETE /identity/v3/users/ba62dadae0ce4d8dafbee3de75183e91 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:29.014403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.020209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:29.034616 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d7536-bc93-4d84-bc60-e3e436ded158 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.127498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.128470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.128921 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.129199 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] PATH_INFO: `/v3/projects/dd3270074180437292afba6e5b5b7854` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.130372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd3270074180437292afba6e5b5b7854)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.132610 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.245489 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79f1af-4a01-4cac-a24a-9c9e44f5d23c None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.246051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79f1af-4a01-4cac-a24a-9c9e44f5d23c None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.246611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79f1af-4a01-4cac-a24a-9c9e44f5d23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.273744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd3270074180437292afba6e5b5b7854', 'request_id': 'req-f506a4b4-daee-420b-9908-6bdb6b562be9'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:29.287362 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-fe79f1af-4a01-4cac-a24a-9c9e44f5d23c None None] MFA Rules not processed for user `7fabfe9cbd604b2dac80959b5ee73880`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:29.288642 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fe79f1af-4a01-4cac-a24a-9c9e44f5d23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:29.308313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:29.360533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1383/2751] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:29.364809 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79f1af-4a01-4cac-a24a-9c9e44f5d23c None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.366521 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fe79f1af-4a01-4cac-a24a-9c9e44f5d23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:29.375082 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd3270074180437292afba6e5b5b7854', 'request_id': 'req-f506a4b4-daee-420b-9908-6bdb6b562be9'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:29.393086 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd3270074180437292afba6e5b5b7854', 'request_id': 'req-f506a4b4-daee-420b-9908-6bdb6b562be9'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:29.408882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] The token cache is being invalidate because project dd3270074180437292afba6e5b5b7854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:29.409697 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:29.411366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f506a4b4-daee-420b-9908-6bdb6b562be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:29.414096 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1369/2752] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:29 2022] DELETE /identity/v3/projects/dd3270074180437292afba6e5b5b7854 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:29.426910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ae22-823a-46ae-bbde-88c8078b98d7 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.429339 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ae22-823a-46ae-bbde-88c8078b98d7 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.430623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4994ae22-823a-46ae-bbde-88c8078b98d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.457382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79f1af-4a01-4cac-a24a-9c9e44f5d23c None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.462230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e8fa-c6ad-46c0-9d14-340ee9901301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.462849 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e8fa-c6ad-46c0-9d14-340ee9901301 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.463133 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e8fa-c6ad-46c0-9d14-340ee9901301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.463408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780e8fa-c6ad-46c0-9d14-340ee9901301 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.464079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780e8fa-c6ad-46c0-9d14-340ee9901301 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.466691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780e8fa-c6ad-46c0-9d14-340ee9901301 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.470919 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-4994ae22-823a-46ae-bbde-88c8078b98d7 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:29.475968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-4994ae22-823a-46ae-bbde-88c8078b98d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:29.494749 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1370/2753] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:29.498426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cd6ec-7ee3-4457-8028-be8117539532 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.498426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cd6ec-7ee3-4457-8028-be8117539532 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.498426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cd6ec-7ee3-4457-8028-be8117539532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.518387 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-547cd6ec-7ee3-4457-8028-be8117539532 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:29.521591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-547cd6ec-7ee3-4457-8028-be8117539532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:29.532349 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1371/2754] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:29.536382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cd6ec-7ee3-4457-8028-be8117539532 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.550202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cd6ec-7ee3-4457-8028-be8117539532 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.551091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08c179-5a71-4dd2-a7cd-d06eb7bfc033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.551852 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08c179-5a71-4dd2-a7cd-d06eb7bfc033 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.552134 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08c179-5a71-4dd2-a7cd-d06eb7bfc033 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.552530 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f08c179-5a71-4dd2-a7cd-d06eb7bfc033 admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.553198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08c179-5a71-4dd2-a7cd-d06eb7bfc033 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:59:29.553499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08c179-5a71-4dd2-a7cd-d06eb7bfc033 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.555076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f08c179-5a71-4dd2-a7cd-d06eb7bfc033 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.567815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1372/2755] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 04 08:59:29.572130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08c179-5a71-4dd2-a7cd-d06eb7bfc033 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.579208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:29.583213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f08c179-5a71-4dd2-a7cd-d06eb7bfc033 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.588021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f481e24-dadc-4956-9803-344478fdbcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.588799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f481e24-dadc-4956-9803-344478fdbcbd admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.589082 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f481e24-dadc-4956-9803-344478fdbcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.589615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f481e24-dadc-4956-9803-344478fdbcbd admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.590255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f481e24-dadc-4956-9803-344478fdbcbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.592865 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f481e24-dadc-4956-9803-344478fdbcbd admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.601805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1384/2756] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:29 2022] POST /identity/v3/projects => generated 373 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:29.608802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e8fa-c6ad-46c0-9d14-340ee9901301 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.610460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7780e8fa-c6ad-46c0-9d14-340ee9901301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:29.678374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780e8fa-c6ad-46c0-9d14-340ee9901301 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.683074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdc1f7-7097-4bdb-a652-a4c93060790d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.683827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdc1f7-7097-4bdb-a652-a4c93060790d admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.684019 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdc1f7-7097-4bdb-a652-a4c93060790d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.684287 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdc1f7-7097-4bdb-a652-a4c93060790d admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.684933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdc1f7-7097-4bdb-a652-a4c93060790d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.686929 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdc1f7-7097-4bdb-a652-a4c93060790d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.690013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1373/2757] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:29 2022] POST /identity/v3/projects => generated 385 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:29.694202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f481e24-dadc-4956-9803-344478fdbcbd admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.755643 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f481e24-dadc-4956-9803-344478fdbcbd admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.760315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3c97-244a-49f5-b249-b77b6ac766b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.760914 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3c97-244a-49f5-b249-b77b6ac766b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.761193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3c97-244a-49f5-b249-b77b6ac766b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.761463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3c97-244a-49f5-b249-b77b6ac766b4 admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.762160 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3c97-244a-49f5-b249-b77b6ac766b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.764611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3c97-244a-49f5-b249-b77b6ac766b4 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.798122 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1385/2758] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:29 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 08:59:29.802057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdc1f7-7097-4bdb-a652-a4c93060790d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.811808 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdc1f7-7097-4bdb-a652-a4c93060790d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.817114 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de581e-17a7-4e48-ba6a-ec4752bc1797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.817692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de581e-17a7-4e48-ba6a-ec4752bc1797 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.817969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de581e-17a7-4e48-ba6a-ec4752bc1797 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.818240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41de581e-17a7-4e48-ba6a-ec4752bc1797 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.818870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de581e-17a7-4e48-ba6a-ec4752bc1797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.820478 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41de581e-17a7-4e48-ba6a-ec4752bc1797 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.831398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1386/2759] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:59:29.835216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de581e-17a7-4e48-ba6a-ec4752bc1797 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.845587 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41de581e-17a7-4e48-ba6a-ec4752bc1797 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.850628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2936571-6b9b-4d81-81e8-f7ac6578d1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.851385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2936571-6b9b-4d81-81e8-f7ac6578d1dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.851767 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2936571-6b9b-4d81-81e8-f7ac6578d1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.852051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2936571-6b9b-4d81-81e8-f7ac6578d1dc admin admin] PATH_INFO: `/v3/projects/98cf1e0cbe7a4f2c927059a019860ae2/users/bef31f96370945a28f2958c30b631798/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.867377 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2936571-6b9b-4d81-81e8-f7ac6578d1dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cf1e0cbe7a4f2c927059a019860ae2, user_id=bef31f96370945a28f2958c30b631798, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.870064 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2936571-6b9b-4d81-81e8-f7ac6578d1dc admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.873935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1374/2760] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:29 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:29.876978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3c97-244a-49f5-b249-b77b6ac766b4 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.886599 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3c97-244a-49f5-b249-b77b6ac766b4 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.892103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf07af-2684-47c7-9769-bcc1d174f6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.892693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf07af-2684-47c7-9769-bcc1d174f6b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.892974 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf07af-2684-47c7-9769-bcc1d174f6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.893249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bf07af-2684-47c7-9769-bcc1d174f6b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.893893 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf07af-2684-47c7-9769-bcc1d174f6b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.895489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bf07af-2684-47c7-9769-bcc1d174f6b0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.905693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1375/2761] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:59:29.909404 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf07af-2684-47c7-9769-bcc1d174f6b0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.919690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bf07af-2684-47c7-9769-bcc1d174f6b0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.924273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52b0b9-c60b-4e5e-8d3e-b3ae7cf46935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:29.924837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52b0b9-c60b-4e5e-8d3e-b3ae7cf46935 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:29.925117 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52b0b9-c60b-4e5e-8d3e-b3ae7cf46935 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:29.928144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52b0b9-c60b-4e5e-8d3e-b3ae7cf46935 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:29.928144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52b0b9-c60b-4e5e-8d3e-b3ae7cf46935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:29.928144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52b0b9-c60b-4e5e-8d3e-b3ae7cf46935 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:29.939408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1376/2762] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:59:29.943298 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52b0b9-c60b-4e5e-8d3e-b3ae7cf46935 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:29.946087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:29.953028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1387/2763] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:29 2022] PUT /identity/v3/projects/98cf1e0cbe7a4f2c927059a019860ae2/users/bef31f96370945a28f2958c30b631798/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:29.953531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52b0b9-c60b-4e5e-8d3e-b3ae7cf46935 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:29.956949 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2936571-6b9b-4d81-81e8-f7ac6578d1dc admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:30.011113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9700f-75f0-4bca-8c96-79e2c07c6db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:30.011838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9700f-75f0-4bca-8c96-79e2c07c6db5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:30.012119 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9700f-75f0-4bca-8c96-79e2c07c6db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:30.012388 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9700f-75f0-4bca-8c96-79e2c07c6db5 admin admin] PATH_INFO: `/v3/projects/7375adf8d5c043fdbd118f486e406c30/users/fab2d56d61804433816cea8070061c48/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:30.021541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2936571-6b9b-4d81-81e8-f7ac6578d1dc admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:30.028595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9700f-75f0-4bca-8c96-79e2c07c6db5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7375adf8d5c043fdbd118f486e406c30, user_id=fab2d56d61804433816cea8070061c48, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:30.029174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ad46-70d1-4c60-9580-530f2a1ca2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:30.029564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ad46-70d1-4c60-9580-530f2a1ca2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:30.029855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ad46-70d1-4c60-9580-530f2a1ca2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:30.030131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ad46-70d1-4c60-9580-530f2a1ca2b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:30.030814 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265ad46-70d1-4c60-9580-530f2a1ca2b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:30.031470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9700f-75f0-4bca-8c96-79e2c07c6db5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:30.032709 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265ad46-70d1-4c60-9580-530f2a1ca2b3 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:30.044442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1388/2764] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:29 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:30.048667 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ad46-70d1-4c60-9580-530f2a1ca2b3 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:30.061110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ad46-70d1-4c60-9580-530f2a1ca2b3 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:30.064628 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8efad9-e9a1-4fe3-9cea-b71ea44c5b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:30.065279 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8efad9-e9a1-4fe3-9cea-b71ea44c5b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:30.065560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8efad9-e9a1-4fe3-9cea-b71ea44c5b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:30.065834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8efad9-e9a1-4fe3-9cea-b71ea44c5b57 admin admin] PATH_INFO: `/v3/projects/98cf1e0cbe7a4f2c927059a019860ae2/users/bef31f96370945a28f2958c30b631798/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:30.067957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8efad9-e9a1-4fe3-9cea-b71ea44c5b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98cf1e0cbe7a4f2c927059a019860ae2, user_id=bef31f96370945a28f2958c30b631798, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:30.070909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8efad9-e9a1-4fe3-9cea-b71ea44c5b57 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:30.082626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1389/2765] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:30 2022] PUT /identity/v3/projects/98cf1e0cbe7a4f2c927059a019860ae2/users/bef31f96370945a28f2958c30b631798/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:30.112487 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1377/2766] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:29 2022] PUT /identity/v3/projects/7375adf8d5c043fdbd118f486e406c30/users/fab2d56d61804433816cea8070061c48/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:30.127039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20507332-35ae-43e9-af71-16ccf50a8c56 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:30.127339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20507332-35ae-43e9-af71-16ccf50a8c56 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:30.127708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20507332-35ae-43e9-af71-16ccf50a8c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:30.156463 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-20507332-35ae-43e9-af71-16ccf50a8c56 None None] MFA Rules not processed for user `fab2d56d61804433816cea8070061c48`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:30.157665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-20507332-35ae-43e9-af71-16ccf50a8c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:30.226841 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1390/2767] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:30 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:30.238636 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9700f-75f0-4bca-8c96-79e2c07c6db5 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:30.240389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1dd9700f-75f0-4bca-8c96-79e2c07c6db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:30.276336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:30.299336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9700f-75f0-4bca-8c96-79e2c07c6db5 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:30.303054 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7448d4-a5b5-45d9-97b8-8d79679eb2c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:30.303689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7448d4-a5b5-45d9-97b8-8d79679eb2c4 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:30.303966 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7448d4-a5b5-45d9-97b8-8d79679eb2c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:30.304255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7448d4-a5b5-45d9-97b8-8d79679eb2c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:30.313624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7448d4-a5b5-45d9-97b8-8d79679eb2c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:30.315098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7448d4-a5b5-45d9-97b8-8d79679eb2c4 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:30.326737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1378/2768] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:33.563983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20507332-35ae-43e9-af71-16ccf50a8c56 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:33.660530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20507332-35ae-43e9-af71-16ccf50a8c56 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:33.665397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:33.666189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:33.666571 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:33.666952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] PATH_INFO: `/v3/users/fab2d56d61804433816cea8070061c48` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:33.668551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab2d56d61804433816cea8070061c48)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:33.671013 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:33.690821 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:33.882879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab2d56d61804433816cea8070061c48'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:33.895237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab2d56d61804433816cea8070061c48'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:33.896443 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab2d56d61804433816cea8070061c48'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:33.897189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab2d56d61804433816cea8070061c48'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:33.956365 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab2d56d61804433816cea8070061c48'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:33.982068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1391/2769] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 08:59:33 2022] DELETE /identity/v3/users/fab2d56d61804433816cea8070061c48 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:33.983851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c0349-5195-411c-930f-a24458d82cbf None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:33.987200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c0349-5195-411c-930f-a24458d82cbf None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:33.987689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c0349-5195-411c-930f-a24458d82cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:34.020826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-0c5c0349-5195-411c-930f-a24458d82cbf None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:34.022483 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0c5c0349-5195-411c-930f-a24458d82cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:34.094264 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1379/2770] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:34.106057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:34.107958 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:34.172876 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4444d-8e62-4c15-b20f-7ca9c20d7564 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:34.176546 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ddf2cc-a95f-41fe-b882-fcd28479d815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:34.177240 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddf2cc-a95f-41fe-b882-fcd28479d815 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:34.177591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddf2cc-a95f-41fe-b882-fcd28479d815 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:34.178403 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ddf2cc-a95f-41fe-b882-fcd28479d815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:34.188995 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ddf2cc-a95f-41fe-b882-fcd28479d815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:34.216079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ddf2cc-a95f-41fe-b882-fcd28479d815 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:34.216079 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1392/2771] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:34.694615 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c0349-5195-411c-930f-a24458d82cbf None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:34.696192 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-0c5c0349-5195-411c-930f-a24458d82cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:34.727077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c0349-5195-411c-930f-a24458d82cbf None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:34.750631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:34.751307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:34.751614 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:34.751894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] PATH_INFO: `/v3/projects/7375adf8d5c043fdbd118f486e406c30` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:34.753283 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7375adf8d5c043fdbd118f486e406c30)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:34.755068 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:34.879840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7375adf8d5c043fdbd118f486e406c30', 'request_id': 'req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:34.951462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7375adf8d5c043fdbd118f486e406c30', 'request_id': 'req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:34.958998 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7375adf8d5c043fdbd118f486e406c30', 'request_id': 'req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:34.970805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] The token cache is being invalidate because project 7375adf8d5c043fdbd118f486e406c30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 08:59:34.971170 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:34.971901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-98e94c3a-520b-4d4d-8fa4-55b1ae35e284 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 08:59:34.973868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1380/2772] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 08:59:34 2022] DELETE /identity/v3/projects/7375adf8d5c043fdbd118f486e406c30 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 08:59:34.978734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852229c-4e4a-44d8-bd21-a6c973cae000 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:34.979232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852229c-4e4a-44d8-bd21-a6c973cae000 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:34.979491 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852229c-4e4a-44d8-bd21-a6c973cae000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.002880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b852229c-4e4a-44d8-bd21-a6c973cae000 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:35.004533 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b852229c-4e4a-44d8-bd21-a6c973cae000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:35.077292 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1393/2773] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:35.147567 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1c52-dc27-40bb-a658-cd4f3d2835e8 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.148157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1c52-dc27-40bb-a658-cd4f3d2835e8 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.148157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00e1c52-dc27-40bb-a658-cd4f3d2835e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.176757 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-a00e1c52-dc27-40bb-a658-cd4f3d2835e8 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:35.178007 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a00e1c52-dc27-40bb-a658-cd4f3d2835e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:35.188319 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1381/2774] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:35.192613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852229c-4e4a-44d8-bd21-a6c973cae000 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:35.203736 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852229c-4e4a-44d8-bd21-a6c973cae000 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:35.210569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb36811-3bd2-45dc-a714-16141bcc7a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:35.210569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb36811-3bd2-45dc-a714-16141bcc7a9e admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.210908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb36811-3bd2-45dc-a714-16141bcc7a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.211342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb36811-3bd2-45dc-a714-16141bcc7a9e admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.219354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb36811-3bd2-45dc-a714-16141bcc7a9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 08:59:35.219847 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb36811-3bd2-45dc-a714-16141bcc7a9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:35.222116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb36811-3bd2-45dc-a714-16141bcc7a9e admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:35.240313 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1394/2775] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 08:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 08:59:35.244456 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e1c52-dc27-40bb-a658-cd4f3d2835e8 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:35.253806 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00e1c52-dc27-40bb-a658-cd4f3d2835e8 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:35.258583 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a925e1-8b77-488b-a6dc-319e20f7128d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:35.259198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a925e1-8b77-488b-a6dc-319e20f7128d admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.259485 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a925e1-8b77-488b-a6dc-319e20f7128d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.259793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a925e1-8b77-488b-a6dc-319e20f7128d admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.260458 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a925e1-8b77-488b-a6dc-319e20f7128d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:35.262390 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a925e1-8b77-488b-a6dc-319e20f7128d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:35.377942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1382/2776] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 08:59:35 2022] POST /identity/v3/projects => generated 373 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:35.381649 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb36811-3bd2-45dc-a714-16141bcc7a9e admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:35.392623 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb36811-3bd2-45dc-a714-16141bcc7a9e admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:35.420087 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:35.483477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d893de-671d-4e7f-b708-71c306847ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:35.484189 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d893de-671d-4e7f-b708-71c306847ed6 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.484482 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d893de-671d-4e7f-b708-71c306847ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.484763 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d893de-671d-4e7f-b708-71c306847ed6 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.485447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d893de-671d-4e7f-b708-71c306847ed6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:35.488663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d893de-671d-4e7f-b708-71c306847ed6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:35.586145 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797024-fa8d-4332-b5ca-a2c8160d78dc None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.586718 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797024-fa8d-4332-b5ca-a2c8160d78dc None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.587006 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797024-fa8d-4332-b5ca-a2c8160d78dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.609922 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1395/2777] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 08:59:35 2022] POST /identity/v3/users => generated 287 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 08:59:35.615778 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d893de-671d-4e7f-b708-71c306847ed6 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:35.634117 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d893de-671d-4e7f-b708-71c306847ed6 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:35.642236 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f94dd7-1ae1-4698-b384-64d16f0338dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:35.642862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94dd7-1ae1-4698-b384-64d16f0338dc admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.643227 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94dd7-1ae1-4698-b384-64d16f0338dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.645590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f94dd7-1ae1-4698-b384-64d16f0338dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.647616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f94dd7-1ae1-4698-b384-64d16f0338dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:35.647744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-d9797024-fa8d-4332-b5ca-a2c8160d78dc None None] MFA Rules not processed for user `bef31f96370945a28f2958c30b631798`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:35.648285 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d9797024-fa8d-4332-b5ca-a2c8160d78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:35.649594 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f94dd7-1ae1-4698-b384-64d16f0338dc admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:35.663490 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1396/2778] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 08:59:35.667674 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f94dd7-1ae1-4698-b384-64d16f0338dc admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:35.678515 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f94dd7-1ae1-4698-b384-64d16f0338dc admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:35.680667 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:35.683188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014b714-c876-4390-8f26-71c332c0bc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:35.683819 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b714-c876-4390-8f26-71c332c0bc24 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.684100 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b714-c876-4390-8f26-71c332c0bc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.684378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0014b714-c876-4390-8f26-71c332c0bc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.685037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014b714-c876-4390-8f26-71c332c0bc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:35.686616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0014b714-c876-4390-8f26-71c332c0bc24 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:35.702861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1397/2779] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 08:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 08:59:35.706794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014b714-c876-4390-8f26-71c332c0bc24 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:35.718243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0014b714-c876-4390-8f26-71c332c0bc24 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:35.727161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592aec0-49bf-4822-9b27-9bbc5601fb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:35.727161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592aec0-49bf-4822-9b27-9bbc5601fb3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.727161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592aec0-49bf-4822-9b27-9bbc5601fb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.727161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592aec0-49bf-4822-9b27-9bbc5601fb3c admin admin] PATH_INFO: `/v3/projects/f92f85977f734ef1bca2fdaaf6f6974a/users/86997a6efd6b4513b49801b009b3df60/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.741266 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592aec0-49bf-4822-9b27-9bbc5601fb3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f92f85977f734ef1bca2fdaaf6f6974a, user_id=86997a6efd6b4513b49801b009b3df60, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:35.744162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3592aec0-49bf-4822-9b27-9bbc5601fb3c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:35.766279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1383/2780] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:35.777393 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9797024-fa8d-4332-b5ca-a2c8160d78dc None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:35.781249 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d9797024-fa8d-4332-b5ca-a2c8160d78dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:35.830294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1398/2781] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 08:59:35 2022] PUT /identity/v3/projects/f92f85977f734ef1bca2fdaaf6f6974a/users/86997a6efd6b4513b49801b009b3df60/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 08:59:35.841719 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d799f-eb68-4e47-bd65-9535b0168f5b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.842018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d799f-eb68-4e47-bd65-9535b0168f5b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.842285 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d799f-eb68-4e47-bd65-9535b0168f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:35.873596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-253d799f-eb68-4e47-bd65-9535b0168f5b None None] MFA Rules not processed for user `86997a6efd6b4513b49801b009b3df60`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:35.875215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-253d799f-eb68-4e47-bd65-9535b0168f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:35.881167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9797024-fa8d-4332-b5ca-a2c8160d78dc None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:35.961715 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1399/2782] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:35.973342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d799f-eb68-4e47-bd65-9535b0168f5b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:35.975696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-253d799f-eb68-4e47-bd65-9535b0168f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:35.991737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd876e7-1fce-418f-b375-c83ae5e69f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:35.991737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd876e7-1fce-418f-b375-c83ae5e69f9d service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:35.991737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd876e7-1fce-418f-b375-c83ae5e69f9d service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:35.991737 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd876e7-1fce-418f-b375-c83ae5e69f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:36.000047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5cd876e7-1fce-418f-b375-c83ae5e69f9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:36.060632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd876e7-1fce-418f-b375-c83ae5e69f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:36.062935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd876e7-1fce-418f-b375-c83ae5e69f9d service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:36.071634 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d799f-eb68-4e47-bd65-9535b0168f5b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:36.076137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1384/2783] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 08:59:36.081639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c06bac6-5732-4bdd-b1ab-4daf9a8b3943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:36.082436 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06bac6-5732-4bdd-b1ab-4daf9a8b3943 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:36.082801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06bac6-5732-4bdd-b1ab-4daf9a8b3943 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:36.083148 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c06bac6-5732-4bdd-b1ab-4daf9a8b3943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:36.089204 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:36.095375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:36.095375 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06bac6-5732-4bdd-b1ab-4daf9a8b3943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:36.095930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c06bac6-5732-4bdd-b1ab-4daf9a8b3943 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:36.105547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1400/2784] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 08:59:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 08:59:37.979716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415f17e-1aba-4b4f-a496-d2a63951cc0b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:37.980229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415f17e-1aba-4b4f-a496-d2a63951cc0b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:37.980348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b415f17e-1aba-4b4f-a496-d2a63951cc0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:38.004325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b415f17e-1aba-4b4f-a496-d2a63951cc0b None None] MFA Rules not processed for user `86997a6efd6b4513b49801b009b3df60`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:38.005543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b415f17e-1aba-4b4f-a496-d2a63951cc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:38.013394 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1385/2785] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 08:59:39.198203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6009fe-e7df-49c3-9404-5537197ebd53 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:39.198688 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6009fe-e7df-49c3-9404-5537197ebd53 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:39.198805 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6009fe-e7df-49c3-9404-5537197ebd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:39.229334 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-ab6009fe-e7df-49c3-9404-5537197ebd53 None None] MFA Rules not processed for user `7fabfe9cbd604b2dac80959b5ee73880`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:39.231720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ab6009fe-e7df-49c3-9404-5537197ebd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:39.260584 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1401/2786] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:47.994475 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=7 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:49.258044 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=17 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 08:59:55.738216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292dac7-9952-4a63-a68d-27217067fdb1 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:55.739043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292dac7-9952-4a63-a68d-27217067fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:55.739043 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292dac7-9952-4a63-a68d-27217067fdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:55.771809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8292dac7-9952-4a63-a68d-27217067fdb1 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:55.773279 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8292dac7-9952-4a63-a68d-27217067fdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:55.852466 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1386/2787] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:59:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:55.864495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6009fe-e7df-49c3-9404-5537197ebd53 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:55.865880 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ab6009fe-e7df-49c3-9404-5537197ebd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:55.946879 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6009fe-e7df-49c3-9404-5537197ebd53 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:55.952602 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235027b6-4cc2-4540-bb4d-3be287ae8be9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:55.953211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235027b6-4cc2-4540-bb4d-3be287ae8be9 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:55.953494 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235027b6-4cc2-4540-bb4d-3be287ae8be9 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:55.953773 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235027b6-4cc2-4540-bb4d-3be287ae8be9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:55.962226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235027b6-4cc2-4540-bb4d-3be287ae8be9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:55.964451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235027b6-4cc2-4540-bb4d-3be287ae8be9 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:55.972739 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1402/2788] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:57.003272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15389bd-1bcd-411c-833b-66431f691d13 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:57.003786 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15389bd-1bcd-411c-833b-66431f691d13 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:57.003871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15389bd-1bcd-411c-833b-66431f691d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:57.024130 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-f15389bd-1bcd-411c-833b-66431f691d13 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:57.025552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f15389bd-1bcd-411c-833b-66431f691d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:57.032825 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1387/2789] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 08:59:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:57.045472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235027b6-4cc2-4540-bb4d-3be287ae8be9 service swift] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:57.056575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235027b6-4cc2-4540-bb4d-3be287ae8be9 service swift] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:57.062775 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2f166-9511-4259-8191-66575477ed66 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:57.063396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2f166-9511-4259-8191-66575477ed66 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:57.063697 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2f166-9511-4259-8191-66575477ed66 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:57.063977 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad2f166-9511-4259-8191-66575477ed66 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:57.072219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2f166-9511-4259-8191-66575477ed66 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:57.074383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad2f166-9511-4259-8191-66575477ed66 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:57.082759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1403/2790] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:57.787289 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c84be-2ba3-4277-9b20-380f2d501f97 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:57.787550 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c84be-2ba3-4277-9b20-380f2d501f97 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:57.787832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89c84be-2ba3-4277-9b20-380f2d501f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:57.807536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b89c84be-2ba3-4277-9b20-380f2d501f97 None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:57.808769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b89c84be-2ba3-4277-9b20-380f2d501f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:57.816044 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1388/2791] 10.222.0.25 () {58 vars in 1009 bytes} [Tue Oct 4 08:59:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:57.827885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2f166-9511-4259-8191-66575477ed66 service swift] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:57.839356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad2f166-9511-4259-8191-66575477ed66 service swift] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:57.844419 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d1ddf-7fa9-4eb4-9a97-4af17fc66391 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:57.850696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d1ddf-7fa9-4eb4-9a97-4af17fc66391 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:57.850696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d1ddf-7fa9-4eb4-9a97-4af17fc66391 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:57.850696 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d1ddf-7fa9-4eb4-9a97-4af17fc66391 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:57.855078 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d1ddf-7fa9-4eb4-9a97-4af17fc66391 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:57.856673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d1ddf-7fa9-4eb4-9a97-4af17fc66391 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:57.864618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1404/2792] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:59:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 08:59:58.471172 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dae82e-cba7-4c50-9311-856ff1e7a08d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:58.471682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dae82e-cba7-4c50-9311-856ff1e7a08d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:58.471823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dae82e-cba7-4c50-9311-856ff1e7a08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:58.493144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-e1dae82e-cba7-4c50-9311-856ff1e7a08d None None] MFA Rules not processed for user `c429ad73f92e4f6d995198189b64406b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 08:59:58.494527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-e1dae82e-cba7-4c50-9311-856ff1e7a08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 08:59:58.502374 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1389/2793] 10.222.0.25 () {58 vars in 967 bytes} [Tue Oct 4 08:59:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 08:59:58.516957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d1ddf-7fa9-4eb4-9a97-4af17fc66391 service swift] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 08:59:58.528798 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d1ddf-7fa9-4eb4-9a97-4af17fc66391 service swift] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 08:59:58.534125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce91a03-85ec-423e-9afe-9addf420fbc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '590ac0c1da06460a8d32852f9c2e3609', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 08:59:58.534831 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce91a03-85ec-423e-9afe-9addf420fbc6 service swift] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 08:59:58.535232 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce91a03-85ec-423e-9afe-9addf420fbc6 service swift] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 08:59:58.535616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce91a03-85ec-423e-9afe-9addf420fbc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 08:59:58.545170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce91a03-85ec-423e-9afe-9addf420fbc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 08:59:58.546991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce91a03-85ec-423e-9afe-9addf420fbc6 service swift] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 08:59:58.555902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1405/2794] 10.222.0.25 () {60 vars in 1384 bytes} [Tue Oct 4 08:59:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 04 09:00:01.194985 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dae82e-cba7-4c50-9311-856ff1e7a08d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:00:01.274664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dae82e-cba7-4c50-9311-856ff1e7a08d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:00:01.279734 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:00:01.280354 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:00:01.280631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:00:01.280903 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] PATH_INFO: `/v3/users/86997a6efd6b4513b49801b009b3df60` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:00:01.282013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86997a6efd6b4513b49801b009b3df60)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:00:01.283935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:00:01.435960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:01.441772 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86997a6efd6b4513b49801b009b3df60'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:01.449703 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86997a6efd6b4513b49801b009b3df60'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:01.450403 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86997a6efd6b4513b49801b009b3df60'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:01.451024 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86997a6efd6b4513b49801b009b3df60'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:01.524077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86997a6efd6b4513b49801b009b3df60'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:01.542382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1390/2795] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:00:01 2022] DELETE /identity/v3/users/86997a6efd6b4513b49801b009b3df60 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:00:01.547891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc3f33-a2ba-43f5-a24b-2fdbac94f93b None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:00:01.547891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc3f33-a2ba-43f5-a24b-2fdbac94f93b None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:00:01.547891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc3f33-a2ba-43f5-a24b-2fdbac94f93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:00:01.586257 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-15dc3f33-a2ba-43f5-a24b-2fdbac94f93b None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:00:01.587461 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-15dc3f33-a2ba-43f5-a24b-2fdbac94f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:00:01.644246 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1406/2796] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:00:01.654460 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:00:01.655881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:00:01.736120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020c8c93-ad46-4787-8763-b6db087adae8 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:00:01.739743 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe8b10-b115-45bc-93ad-d066d6acf932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:00:01.740426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe8b10-b115-45bc-93ad-d066d6acf932 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:00:01.740706 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe8b10-b115-45bc-93ad-d066d6acf932 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:00:01.740976 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe8b10-b115-45bc-93ad-d066d6acf932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:00:01.749764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe8b10-b115-45bc-93ad-d066d6acf932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:00:01.756368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fe8b10-b115-45bc-93ad-d066d6acf932 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:00:01.760907 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1391/2797] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:00:01.984661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc3f33-a2ba-43f5-a24b-2fdbac94f93b None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:00:01.986181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-15dc3f33-a2ba-43f5-a24b-2fdbac94f93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:00:01.999673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc3f33-a2ba-43f5-a24b-2fdbac94f93b None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:00:02.005823 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:00:02.008646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:00:02.008646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:00:02.008646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] PATH_INFO: `/v3/projects/f92f85977f734ef1bca2fdaaf6f6974a` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:00:02.008646 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f92f85977f734ef1bca2fdaaf6f6974a)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:00:02.010196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:00:02.035178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:02.141141 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f92f85977f734ef1bca2fdaaf6f6974a', 'request_id': 'req-9b0c97a5-be3b-4706-8e60-1ce057a5b637'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:02.220981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f92f85977f734ef1bca2fdaaf6f6974a', 'request_id': 'req-9b0c97a5-be3b-4706-8e60-1ce057a5b637'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:02.227255 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f92f85977f734ef1bca2fdaaf6f6974a', 'request_id': 'req-9b0c97a5-be3b-4706-8e60-1ce057a5b637'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:02.241774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] The token cache is being invalidate because project f92f85977f734ef1bca2fdaaf6f6974a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:00:02.241774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:02.241774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:00:02.241774 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1407/2798] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:00:01 2022] DELETE /identity/v3/projects/f92f85977f734ef1bca2fdaaf6f6974a => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:00:08.101594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe8b10-b115-45bc-93ad-d066d6acf932 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:00:08.110645 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe8b10-b115-45bc-93ad-d066d6acf932 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:00:08.157878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e2512-d79e-4a8a-ba5d-4c3af03c712e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:00:08.158489 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e2512-d79e-4a8a-ba5d-4c3af03c712e service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:00:08.158765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e2512-d79e-4a8a-ba5d-4c3af03c712e service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:00:08.159041 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e2512-d79e-4a8a-ba5d-4c3af03c712e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:00:08.160780 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9e6e2512-d79e-4a8a-ba5d-4c3af03c712e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:00:08.210514 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:08.223066 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e2512-d79e-4a8a-ba5d-4c3af03c712e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:00:08.224511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e2512-d79e-4a8a-ba5d-4c3af03c712e service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:00:08.234471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1392/2799] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:00:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:00:12.234391 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=7,keystone:SELECT=15,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:17.973434 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:00:17.974925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:00:18.070982 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0c97a5-be3b-4706-8e60-1ce057a5b637 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:00:18.075931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:00:18.076542 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:00:18.076825 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:00:18.077102 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:00:18.078839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:00:18.093035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:00:18.094801 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:00:18.107355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1408/2800] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:00:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:00:18.299838 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=5 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:22.488504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7064-47dd-4f2b-8264-0b40fde2d194 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:00:22.490346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7064-47dd-4f2b-8264-0b40fde2d194 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:00:22.490346 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf7064-47dd-4f2b-8264-0b40fde2d194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:00:22.507693 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-d8cf7064-47dd-4f2b-8264-0b40fde2d194 None None] MFA Rules not processed for user `f9590b2b76244d4f8b375a1782a6b99c`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:00:22.508851 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d8cf7064-47dd-4f2b-8264-0b40fde2d194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:00:22.562308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1393/2801] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:00:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:00:28.102196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=41 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:00:32.555839 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=25 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:42.198555 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:42.200196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:42.267389 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c5b15a-84e8-4694-a153-8666c00b4d72 service placement] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:42.271893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:42.272511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.272789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.273061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] PATH_INFO: `/v3/users/f9590b2b76244d4f8b375a1782a6b99c` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:42.274164 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9590b2b76244d4f8b375a1782a6b99c)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:42.276090 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:42.440432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9590b2b76244d4f8b375a1782a6b99c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:42.447553 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9590b2b76244d4f8b375a1782a6b99c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:42.448314 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9590b2b76244d4f8b375a1782a6b99c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:42.448917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9590b2b76244d4f8b375a1782a6b99c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:42.529131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-bb45958f-f3cb-481e-8011-070fdb502568 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9590b2b76244d4f8b375a1782a6b99c'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:42.546265 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1409/2802] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:42 2022] DELETE /identity/v3/users/f9590b2b76244d4f8b375a1782a6b99c => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:42.811315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf7064-47dd-4f2b-8264-0b40fde2d194 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:42.822964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf7064-47dd-4f2b-8264-0b40fde2d194 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:42.880961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:42.881597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:42.881882 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:42.882155 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] PATH_INFO: `/v3/projects/382dfc6c4f0948b0aa434fc7252f4e00` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:42.883271 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=382dfc6c4f0948b0aa434fc7252f4e00)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:42.885208 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:42.994040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '382dfc6c4f0948b0aa434fc7252f4e00', 'request_id': 'req-5ce65bc2-91bb-4533-b252-db59cb0f5a90'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:43.049875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '382dfc6c4f0948b0aa434fc7252f4e00', 'request_id': 'req-5ce65bc2-91bb-4533-b252-db59cb0f5a90'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:43.056327 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '382dfc6c4f0948b0aa434fc7252f4e00', 'request_id': 'req-5ce65bc2-91bb-4533-b252-db59cb0f5a90'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:43.066669 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] The token cache is being invalidate because project 382dfc6c4f0948b0aa434fc7252f4e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:43.066962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:43.067625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5ce65bc2-91bb-4533-b252-db59cb0f5a90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:43.069114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1394/2803] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:42 2022] DELETE /identity/v3/projects/382dfc6c4f0948b0aa434fc7252f4e00 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:43.074262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ed4c-2eca-4bc5-98cb-b508fcb67a01 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.074548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ed4c-2eca-4bc5-98cb-b508fcb67a01 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.074827 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161ed4c-2eca-4bc5-98cb-b508fcb67a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.125817 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-9161ed4c-2eca-4bc5-98cb-b508fcb67a01 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:43.127031 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-9161ed4c-2eca-4bc5-98cb-b508fcb67a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:43.174452 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:43.185916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1410/2804] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:43.195016 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b545f02-f824-4f83-b85e-73b4a83a7645 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.195307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b545f02-f824-4f83-b85e-73b4a83a7645 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.195619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b545f02-f824-4f83-b85e-73b4a83a7645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.216193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-8b545f02-f824-4f83-b85e-73b4a83a7645 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:43.217419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-8b545f02-f824-4f83-b85e-73b4a83a7645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:43.225350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1395/2805] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:43.229575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161ed4c-2eca-4bc5-98cb-b508fcb67a01 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.239195 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161ed4c-2eca-4bc5-98cb-b508fcb67a01 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.244339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46380a9-898c-4b38-a104-e76f18e62807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.247120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46380a9-898c-4b38-a104-e76f18e62807 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.247120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46380a9-898c-4b38-a104-e76f18e62807 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.247120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46380a9-898c-4b38-a104-e76f18e62807 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.247120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46380a9-898c-4b38-a104-e76f18e62807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:43.247120 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46380a9-898c-4b38-a104-e76f18e62807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.248085 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46380a9-898c-4b38-a104-e76f18e62807 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:43.261497 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1411/2806] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:43.266091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b545f02-f824-4f83-b85e-73b4a83a7645 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.275198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b545f02-f824-4f83-b85e-73b4a83a7645 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.279901 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb86c0-0825-43ab-b668-0dd6c09c1918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.280499 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb86c0-0825-43ab-b668-0dd6c09c1918 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.280784 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb86c0-0825-43ab-b668-0dd6c09c1918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.281085 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb86c0-0825-43ab-b668-0dd6c09c1918 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.281729 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb86c0-0825-43ab-b668-0dd6c09c1918 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.283666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96eb86c0-0825-43ab-b668-0dd6c09c1918 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:43.364961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1396/2807] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:43 2022] POST /identity/v3/projects => generated 373 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:43.369251 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46380a9-898c-4b38-a104-e76f18e62807 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.379814 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46380a9-898c-4b38-a104-e76f18e62807 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.434799 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ee82d-88e0-47f6-b3e9-5e6ea2777cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.435396 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ee82d-88e0-47f6-b3e9-5e6ea2777cb4 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.435708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ee82d-88e0-47f6-b3e9-5e6ea2777cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.435987 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ee82d-88e0-47f6-b3e9-5e6ea2777cb4 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.436624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ee82d-88e0-47f6-b3e9-5e6ea2777cb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.439001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2ee82d-88e0-47f6-b3e9-5e6ea2777cb4 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:43.564315 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1412/2808] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:43 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:43.568467 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb86c0-0825-43ab-b668-0dd6c09c1918 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.579818 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb86c0-0825-43ab-b668-0dd6c09c1918 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.584562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93a070-c0db-4b5f-be9b-2bde28a82c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.585167 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93a070-c0db-4b5f-be9b-2bde28a82c59 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.585449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93a070-c0db-4b5f-be9b-2bde28a82c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.585723 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb93a070-c0db-4b5f-be9b-2bde28a82c59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.586372 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93a070-c0db-4b5f-be9b-2bde28a82c59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.588048 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb93a070-c0db-4b5f-be9b-2bde28a82c59 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:43.598090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1397/2809] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:01:43.602053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ee82d-88e0-47f6-b3e9-5e6ea2777cb4 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.612374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ee82d-88e0-47f6-b3e9-5e6ea2777cb4 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.617003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561dd54-157d-49e8-89dc-8cf41fc2d605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.617530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561dd54-157d-49e8-89dc-8cf41fc2d605 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.617803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561dd54-157d-49e8-89dc-8cf41fc2d605 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.618071 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561dd54-157d-49e8-89dc-8cf41fc2d605 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.618703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561dd54-157d-49e8-89dc-8cf41fc2d605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.620308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5561dd54-157d-49e8-89dc-8cf41fc2d605 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:43.630509 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1413/2810] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:43.634420 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93a070-c0db-4b5f-be9b-2bde28a82c59 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.644284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb93a070-c0db-4b5f-be9b-2bde28a82c59 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.649008 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83f4de-ee01-4446-9e4f-e9e94875333e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.649687 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f4de-ee01-4446-9e4f-e9e94875333e admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.649967 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f4de-ee01-4446-9e4f-e9e94875333e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.650241 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83f4de-ee01-4446-9e4f-e9e94875333e admin admin] PATH_INFO: `/v3/projects/0e562e2868bb41beb64ec1710c66a676/users/6e3156cb3c5e4ed9a6440bf55e97669b/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.664823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83f4de-ee01-4446-9e4f-e9e94875333e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e562e2868bb41beb64ec1710c66a676, user_id=6e3156cb3c5e4ed9a6440bf55e97669b, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.667436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83f4de-ee01-4446-9e4f-e9e94875333e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:43.764540 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1398/2811] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:43 2022] PUT /identity/v3/projects/0e562e2868bb41beb64ec1710c66a676/users/6e3156cb3c5e4ed9a6440bf55e97669b/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:43.774938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358be5ad-6f1a-4ac7-8501-352e87ac0071 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.775233 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358be5ad-6f1a-4ac7-8501-352e87ac0071 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.775538 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358be5ad-6f1a-4ac7-8501-352e87ac0071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.803591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-358be5ad-6f1a-4ac7-8501-352e87ac0071 None None] MFA Rules not processed for user `6e3156cb3c5e4ed9a6440bf55e97669b`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:43.804815 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-358be5ad-6f1a-4ac7-8501-352e87ac0071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:43.868439 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1414/2812] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:01:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:43.880213 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83f4de-ee01-4446-9e4f-e9e94875333e admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:43.881934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5b83f4de-ee01-4446-9e4f-e9e94875333e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:43.904161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:43.977809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83f4de-ee01-4446-9e4f-e9e94875333e admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:43.983463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d144c9c-1042-49cc-ab47-4d65c382ce88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:43.985826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d144c9c-1042-49cc-ab47-4d65c382ce88 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:43.985826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d144c9c-1042-49cc-ab47-4d65c382ce88 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:43.985826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d144c9c-1042-49cc-ab47-4d65c382ce88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:43.993320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d144c9c-1042-49cc-ab47-4d65c382ce88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:43.994892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d144c9c-1042-49cc-ab47-4d65c382ce88 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:44.003905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1399/2813] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:44.203611 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358be5ad-6f1a-4ac7-8501-352e87ac0071 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:44.253046 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:44.264485 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358be5ad-6f1a-4ac7-8501-352e87ac0071 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:44.269061 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:44.269683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.272105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.272105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] PATH_INFO: `/v3/users/6e3156cb3c5e4ed9a6440bf55e97669b` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.272105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e3156cb3c5e4ed9a6440bf55e97669b)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:44.273291 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:44.388038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e3156cb3c5e4ed9a6440bf55e97669b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:44.395361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e3156cb3c5e4ed9a6440bf55e97669b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:44.396054 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e3156cb3c5e4ed9a6440bf55e97669b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:44.396726 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e3156cb3c5e4ed9a6440bf55e97669b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:44.494723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e3156cb3c5e4ed9a6440bf55e97669b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:44.511909 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1415/2814] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:01:44 2022] DELETE /identity/v3/users/6e3156cb3c5e4ed9a6440bf55e97669b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:44.516877 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd000-94c3-47e2-aeb3-8ea42c19f932 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.517157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd000-94c3-47e2-aeb3-8ea42c19f932 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.517426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1fd000-94c3-47e2-aeb3-8ea42c19f932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.536704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-cd1fd000-94c3-47e2-aeb3-8ea42c19f932 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:44.537894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cd1fd000-94c3-47e2-aeb3-8ea42c19f932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:44.595161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1400/2815] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:44.604950 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:44.606333 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:44.661828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ac6f9-84ba-431f-9892-a9aae03d5c5a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:44.665324 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb04714-456d-421c-8494-406b3e129100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:44.665918 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb04714-456d-421c-8494-406b3e129100 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:44.666196 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb04714-456d-421c-8494-406b3e129100 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:44.666464 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb04714-456d-421c-8494-406b3e129100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:44.675136 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb04714-456d-421c-8494-406b3e129100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:44.676579 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb04714-456d-421c-8494-406b3e129100 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:44.685776 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1416/2816] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:45.091641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fd000-94c3-47e2-aeb3-8ea42c19f932 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.093195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cd1fd000-94c3-47e2-aeb3-8ea42c19f932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:45.113276 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1fd000-94c3-47e2-aeb3-8ea42c19f932 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.118987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35177126-818b-466d-992f-4836ae99380e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.119870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35177126-818b-466d-992f-4836ae99380e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.120220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35177126-818b-466d-992f-4836ae99380e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.120501 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35177126-818b-466d-992f-4836ae99380e admin admin] PATH_INFO: `/v3/projects/0e562e2868bb41beb64ec1710c66a676` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.121625 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35177126-818b-466d-992f-4836ae99380e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e562e2868bb41beb64ec1710c66a676)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.123554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35177126-818b-466d-992f-4836ae99380e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.227351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-35177126-818b-466d-992f-4836ae99380e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e562e2868bb41beb64ec1710c66a676', 'request_id': 'req-35177126-818b-466d-992f-4836ae99380e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.300601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-35177126-818b-466d-992f-4836ae99380e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e562e2868bb41beb64ec1710c66a676', 'request_id': 'req-35177126-818b-466d-992f-4836ae99380e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.307074 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-35177126-818b-466d-992f-4836ae99380e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e562e2868bb41beb64ec1710c66a676', 'request_id': 'req-35177126-818b-466d-992f-4836ae99380e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.317619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-35177126-818b-466d-992f-4836ae99380e admin admin] The token cache is being invalidate because project 0e562e2868bb41beb64ec1710c66a676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:01:45.317911 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-35177126-818b-466d-992f-4836ae99380e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.318536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-35177126-818b-466d-992f-4836ae99380e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:01:45.320277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1401/2817] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:01:45 2022] DELETE /identity/v3/projects/0e562e2868bb41beb64ec1710c66a676 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:45.325125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548d86-4e48-43aa-ae13-1737a01f896d None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.325639 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548d86-4e48-43aa-ae13-1737a01f896d None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.325737 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e548d86-4e48-43aa-ae13-1737a01f896d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.345829 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-7e548d86-4e48-43aa-ae13-1737a01f896d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:45.347025 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-7e548d86-4e48-43aa-ae13-1737a01f896d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:45.402683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1417/2818] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:45.411430 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b62e0-755c-4fd9-8fbe-e9b7d4988a34 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.411741 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b62e0-755c-4fd9-8fbe-e9b7d4988a34 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.412013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b62e0-755c-4fd9-8fbe-e9b7d4988a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.426488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:45.431945 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b64b62e0-755c-4fd9-8fbe-e9b7d4988a34 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:45.437488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b64b62e0-755c-4fd9-8fbe-e9b7d4988a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:45.441528 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1402/2819] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:45.445746 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e548d86-4e48-43aa-ae13-1737a01f896d None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.456278 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e548d86-4e48-43aa-ae13-1737a01f896d None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.460945 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c8f6-0d4e-4c5e-92f6-2acc4e20e3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.465959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c8f6-0d4e-4c5e-92f6-2acc4e20e3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.465959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c8f6-0d4e-4c5e-92f6-2acc4e20e3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.465959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a584c8f6-0d4e-4c5e-92f6-2acc4e20e3a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.465959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584c8f6-0d4e-4c5e-92f6-2acc4e20e3a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:01:45.465959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584c8f6-0d4e-4c5e-92f6-2acc4e20e3a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.465959 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a584c8f6-0d4e-4c5e-92f6-2acc4e20e3a1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.473007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:45.476215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1418/2820] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 09:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:01:45.480639 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b62e0-755c-4fd9-8fbe-e9b7d4988a34 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.489711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64b62e0-755c-4fd9-8fbe-e9b7d4988a34 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.494623 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204527e1-365f-4f68-bb11-8fbd626175f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.495210 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204527e1-365f-4f68-bb11-8fbd626175f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.495488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204527e1-365f-4f68-bb11-8fbd626175f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.495809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204527e1-365f-4f68-bb11-8fbd626175f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.496443 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204527e1-365f-4f68-bb11-8fbd626175f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.498348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204527e1-365f-4f68-bb11-8fbd626175f6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.552704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1403/2821] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:45 2022] POST /identity/v3/projects => generated 375 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:45.557000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c8f6-0d4e-4c5e-92f6-2acc4e20e3a1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.567705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a584c8f6-0d4e-4c5e-92f6-2acc4e20e3a1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.622582 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cdff4-9402-465c-9a6e-e4b04d4fb550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.623215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cdff4-9402-465c-9a6e-e4b04d4fb550 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.623657 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cdff4-9402-465c-9a6e-e4b04d4fb550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.623938 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2cdff4-9402-465c-9a6e-e4b04d4fb550 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.625129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cdff4-9402-465c-9a6e-e4b04d4fb550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.627022 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2cdff4-9402-465c-9a6e-e4b04d4fb550 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.741351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1419/2822] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:45 2022] POST /identity/v3/users => generated 288 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:45.745449 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204527e1-365f-4f68-bb11-8fbd626175f6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.756338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204527e1-365f-4f68-bb11-8fbd626175f6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.760842 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e715-f595-466c-a1af-552231c389a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.761434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e715-f595-466c-a1af-552231c389a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.761711 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e715-f595-466c-a1af-552231c389a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.761979 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b17e715-f595-466c-a1af-552231c389a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.762662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17e715-f595-466c-a1af-552231c389a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.764275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b17e715-f595-466c-a1af-552231c389a6 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.774634 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1404/2823] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:45.778576 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cdff4-9402-465c-9a6e-e4b04d4fb550 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.788312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2cdff4-9402-465c-9a6e-e4b04d4fb550 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.792862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0496dc7b-1eab-4cda-a7a2-9d688490a13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.793442 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496dc7b-1eab-4cda-a7a2-9d688490a13c admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.793720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496dc7b-1eab-4cda-a7a2-9d688490a13c admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.793992 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0496dc7b-1eab-4cda-a7a2-9d688490a13c admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.794624 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496dc7b-1eab-4cda-a7a2-9d688490a13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.796226 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0496dc7b-1eab-4cda-a7a2-9d688490a13c admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.806523 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1420/2824] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:45 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:45.810392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e715-f595-466c-a1af-552231c389a6 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:45.820411 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b17e715-f595-466c-a1af-552231c389a6 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:45.824898 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aeee9-0090-48e1-bf0d-20945092141d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:45.825532 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aeee9-0090-48e1-bf0d-20945092141d admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.825809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aeee9-0090-48e1-bf0d-20945092141d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.826101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4aeee9-0090-48e1-bf0d-20945092141d admin admin] PATH_INFO: `/v3/projects/c4800471fc6042149fb36ba18f8b15f1/users/96d8df21f4b54b33aacf23eaedc6a5ed/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.840943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aeee9-0090-48e1-bf0d-20945092141d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4800471fc6042149fb36ba18f8b15f1, user_id=96d8df21f4b54b33aacf23eaedc6a5ed, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:45.843675 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4aeee9-0090-48e1-bf0d-20945092141d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:45.918079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1405/2825] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:45 2022] PUT /identity/v3/projects/c4800471fc6042149fb36ba18f8b15f1/users/96d8df21f4b54b33aacf23eaedc6a5ed/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:45.930162 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23bc53-e2f2-4063-8a62-4f366c2f148f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:45.930443 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23bc53-e2f2-4063-8a62-4f366c2f148f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:45.930712 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23bc53-e2f2-4063-8a62-4f366c2f148f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:45.959159 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-8b23bc53-e2f2-4063-8a62-4f366c2f148f None None] MFA Rules not processed for user `96d8df21f4b54b33aacf23eaedc6a5ed`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:45.960409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8b23bc53-e2f2-4063-8a62-4f366c2f148f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:46.022532 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1421/2826] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:01:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:46.027143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aeee9-0090-48e1-bf0d-20945092141d admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.088560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4aeee9-0090-48e1-bf0d-20945092141d admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.093210 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa9bb4-47a5-4c04-9392-afb44289fce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.093815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa9bb4-47a5-4c04-9392-afb44289fce2 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.094121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa9bb4-47a5-4c04-9392-afb44289fce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.094396 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa9bb4-47a5-4c04-9392-afb44289fce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.095064 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa9bb4-47a5-4c04-9392-afb44289fce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.097009 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aa9bb4-47a5-4c04-9392-afb44289fce2 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.205441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1406/2827] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:01:46 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:01:46.209665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23bc53-e2f2-4063-8a62-4f366c2f148f None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.220547 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23bc53-e2f2-4063-8a62-4f366c2f148f None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.275477 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1efa2-9783-4500-bf68-6b03985fef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.276034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1efa2-9783-4500-bf68-6b03985fef63 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.276316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1efa2-9783-4500-bf68-6b03985fef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.276590 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e1efa2-9783-4500-bf68-6b03985fef63 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.277230 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1efa2-9783-4500-bf68-6b03985fef63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.279130 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e1efa2-9783-4500-bf68-6b03985fef63 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.341548 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:46.348142 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1422/2828] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:01:46 2022] POST /identity/v3/users => generated 294 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:01:46.352210 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa9bb4-47a5-4c04-9392-afb44289fce2 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.363246 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa9bb4-47a5-4c04-9392-afb44289fce2 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.367841 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490c4d-cbc1-4511-adcb-5e89fe750593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.368436 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490c4d-cbc1-4511-adcb-5e89fe750593 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.368717 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490c4d-cbc1-4511-adcb-5e89fe750593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.368992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84490c4d-cbc1-4511-adcb-5e89fe750593 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.369631 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490c4d-cbc1-4511-adcb-5e89fe750593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.371209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84490c4d-cbc1-4511-adcb-5e89fe750593 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.381653 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1407/2829] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:46.385690 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1efa2-9783-4500-bf68-6b03985fef63 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.395591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e1efa2-9783-4500-bf68-6b03985fef63 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.400155 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c46917-dde1-40c6-bed9-32c5a3f78d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.406241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c46917-dde1-40c6-bed9-32c5a3f78d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.406241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c46917-dde1-40c6-bed9-32c5a3f78d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.406241 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c46917-dde1-40c6-bed9-32c5a3f78d41 admin admin] PATH_INFO: `/v3/projects/2ab1b25a77594344a4612fb9df2e00e9/users/6f9f24bd2fbf49018b8f7fd2cf3705c4/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.417215 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c46917-dde1-40c6-bed9-32c5a3f78d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab1b25a77594344a4612fb9df2e00e9, user_id=6f9f24bd2fbf49018b8f7fd2cf3705c4, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.419952 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c46917-dde1-40c6-bed9-32c5a3f78d41 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.494999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1423/2830] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:46 2022] PUT /identity/v3/projects/2ab1b25a77594344a4612fb9df2e00e9/users/6f9f24bd2fbf49018b8f7fd2cf3705c4/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:46.498947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490c4d-cbc1-4511-adcb-5e89fe750593 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.508929 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84490c4d-cbc1-4511-adcb-5e89fe750593 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.564237 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228aa08-f994-49cc-9b13-af61c59362c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.564760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228aa08-f994-49cc-9b13-af61c59362c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.565035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228aa08-f994-49cc-9b13-af61c59362c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.565307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228aa08-f994-49cc-9b13-af61c59362c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.565937 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228aa08-f994-49cc-9b13-af61c59362c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.567527 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228aa08-f994-49cc-9b13-af61c59362c1 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.578040 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1408/2831] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:01:46.582026 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c46917-dde1-40c6-bed9-32c5a3f78d41 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.592839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c46917-dde1-40c6-bed9-32c5a3f78d41 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.598201 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d82d84-edac-441c-a41a-b376f1be1f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.598863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d82d84-edac-441c-a41a-b376f1be1f8f admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.599146 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d82d84-edac-441c-a41a-b376f1be1f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.599422 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d82d84-edac-441c-a41a-b376f1be1f8f admin admin] PATH_INFO: `/v3/projects/2ab1b25a77594344a4612fb9df2e00e9/users/6f9f24bd2fbf49018b8f7fd2cf3705c4/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.602145 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d82d84-edac-441c-a41a-b376f1be1f8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab1b25a77594344a4612fb9df2e00e9, user_id=6f9f24bd2fbf49018b8f7fd2cf3705c4, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.604946 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d82d84-edac-441c-a41a-b376f1be1f8f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.615710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1424/2832] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:01:46 2022] PUT /identity/v3/projects/2ab1b25a77594344a4612fb9df2e00e9/users/6f9f24bd2fbf49018b8f7fd2cf3705c4/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:01:46.627535 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe4815-6fad-4620-8ef0-8953cc68d6f9 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.627883 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe4815-6fad-4620-8ef0-8953cc68d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.628121 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbe4815-6fad-4620-8ef0-8953cc68d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.653147 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:01:46.656536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-abbe4815-6fad-4620-8ef0-8953cc68d6f9 None None] MFA Rules not processed for user `6f9f24bd2fbf49018b8f7fd2cf3705c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:01:46.657744 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-abbe4815-6fad-4620-8ef0-8953cc68d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:46.725348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1409/2833] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:01:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:01:46.736106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d82d84-edac-441c-a41a-b376f1be1f8f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:46.737769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f5d82d84-edac-441c-a41a-b376f1be1f8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:01:46.814374 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d82d84-edac-441c-a41a-b376f1be1f8f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:46.818016 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d43694-52f5-4483-9f82-79c6f6bb98a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:46.818608 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d43694-52f5-4483-9f82-79c6f6bb98a8 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:46.818891 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d43694-52f5-4483-9f82-79c6f6bb98a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:46.819167 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d43694-52f5-4483-9f82-79c6f6bb98a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:46.873978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d43694-52f5-4483-9f82-79c6f6bb98a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:46.875406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d43694-52f5-4483-9f82-79c6f6bb98a8 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:46.884166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1425/2834] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:50.389862 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe4815-6fad-4620-8ef0-8953cc68d6f9 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:01:50.399386 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbe4815-6fad-4620-8ef0-8953cc68d6f9 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:01:50.402913 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546d9b0-2711-47ba-898e-3aef28b6d6d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:01:50.403526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546d9b0-2711-47ba-898e-3aef28b6d6d2 service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:01:50.403815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546d9b0-2711-47ba-898e-3aef28b6d6d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:01:50.404088 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546d9b0-2711-47ba-898e-3aef28b6d6d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:01:50.412854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546d9b0-2711-47ba-898e-3aef28b6d6d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:01:50.414253 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546d9b0-2711-47ba-898e-3aef28b6d6d2 service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:01:50.423471 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1410/2835] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:01:50 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:01:56.880552 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=73,keystone:INSERT=2 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:00.419307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=34 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:04.987893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d43694-52f5-4483-9f82-79c6f6bb98a8 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.049018 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d43694-52f5-4483-9f82-79c6f6bb98a8 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.053573 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.054214 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.054498 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.054769 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] PATH_INFO: `/v3/users/96d8df21f4b54b33aacf23eaedc6a5ed` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.055898 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] RBAC: Authorizing `identity:delete_user(user_id=96d8df21f4b54b33aacf23eaedc6a5ed)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.057843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.238480 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96d8df21f4b54b33aacf23eaedc6a5ed'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.245748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96d8df21f4b54b33aacf23eaedc6a5ed'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.249568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96d8df21f4b54b33aacf23eaedc6a5ed'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.249568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96d8df21f4b54b33aacf23eaedc6a5ed'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.304932 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96d8df21f4b54b33aacf23eaedc6a5ed'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:05.323017 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1426/2836] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:04 2022] DELETE /identity/v3/users/96d8df21f4b54b33aacf23eaedc6a5ed => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:05.327735 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559861f-7f8b-48f9-b7a5-b6d99ff470cc None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.328214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559861f-7f8b-48f9-b7a5-b6d99ff470cc None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.328325 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559861f-7f8b-48f9-b7a5-b6d99ff470cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.347833 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-6559861f-7f8b-48f9-b7a5-b6d99ff470cc None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:05.349026 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6559861f-7f8b-48f9-b7a5-b6d99ff470cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.406662 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1411/2837] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:05.416449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.417866 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.473407 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffabb448-888e-4c8a-82fc-f5eee8c4810b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.477023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e99345-e35a-48eb-9ece-8f4939489caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.477621 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e99345-e35a-48eb-9ece-8f4939489caf service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.477902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e99345-e35a-48eb-9ece-8f4939489caf service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.478177 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e99345-e35a-48eb-9ece-8f4939489caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.486970 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e99345-e35a-48eb-9ece-8f4939489caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.488425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e99345-e35a-48eb-9ece-8f4939489caf service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:05.498204 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1427/2838] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:05.878702 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559861f-7f8b-48f9-b7a5-b6d99ff470cc None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:05.880478 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6559861f-7f8b-48f9-b7a5-b6d99ff470cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:05.892754 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559861f-7f8b-48f9-b7a5-b6d99ff470cc None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:05.898350 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:05.899003 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:05.899274 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:05.899613 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] PATH_INFO: `/v3/projects/c4800471fc6042149fb36ba18f8b15f1` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:05.900748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4800471fc6042149fb36ba18f8b15f1)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:05.902848 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.031875 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4800471fc6042149fb36ba18f8b15f1', 'request_id': 'req-578baf0c-1176-46eb-8bcd-46e84cc06032'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.104441 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4800471fc6042149fb36ba18f8b15f1', 'request_id': 'req-578baf0c-1176-46eb-8bcd-46e84cc06032'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.110821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4800471fc6042149fb36ba18f8b15f1', 'request_id': 'req-578baf0c-1176-46eb-8bcd-46e84cc06032'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.121361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] The token cache is being invalidate because project c4800471fc6042149fb36ba18f8b15f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:06.121647 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.122299 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.123815 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1412/2839] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:05 2022] DELETE /identity/v3/projects/c4800471fc6042149fb36ba18f8b15f1 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:06.127896 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e99345-e35a-48eb-9ece-8f4939489caf service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.137342 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e99345-e35a-48eb-9ece-8f4939489caf service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.155010 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:06.191981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.192647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.192930 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.193211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] PATH_INFO: `/v3/users/6f9f24bd2fbf49018b8f7fd2cf3705c4` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.194339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9f24bd2fbf49018b8f7fd2cf3705c4)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.196320 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:06.347560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9f24bd2fbf49018b8f7fd2cf3705c4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.354223 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9f24bd2fbf49018b8f7fd2cf3705c4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.354872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9f24bd2fbf49018b8f7fd2cf3705c4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.355529 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9f24bd2fbf49018b8f7fd2cf3705c4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.408200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-8e07149c-6a63-4f77-8468-639d98bb9912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9f24bd2fbf49018b8f7fd2cf3705c4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:06.426336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1428/2840] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:06 2022] DELETE /identity/v3/users/6f9f24bd2fbf49018b8f7fd2cf3705c4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:06.821570 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:06.823035 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:06.839809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578baf0c-1176-46eb-8bcd-46e84cc06032 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:06.895275 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:06.895853 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:06.896131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:06.896424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] PATH_INFO: `/v3/projects/2ab1b25a77594344a4612fb9df2e00e9` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:06.897564 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab1b25a77594344a4612fb9df2e00e9)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:06.899470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.009546 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:07.026013 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab1b25a77594344a4612fb9df2e00e9', 'request_id': 'req-dd5851d5-5176-4053-bb3d-7acaf3605f8e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.093452 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab1b25a77594344a4612fb9df2e00e9', 'request_id': 'req-dd5851d5-5176-4053-bb3d-7acaf3605f8e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.100408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab1b25a77594344a4612fb9df2e00e9', 'request_id': 'req-dd5851d5-5176-4053-bb3d-7acaf3605f8e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.110713 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] The token cache is being invalidate because project 2ab1b25a77594344a4612fb9df2e00e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:07.111004 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.111681 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-dd5851d5-5176-4053-bb3d-7acaf3605f8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:07.113168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1413/2841] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:06 2022] DELETE /identity/v3/projects/2ab1b25a77594344a4612fb9df2e00e9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:07.120983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee889e-c520-4abb-a1cb-4e9c0ca22661 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.121300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee889e-c520-4abb-a1cb-4e9c0ca22661 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.121645 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee889e-c520-4abb-a1cb-4e9c0ca22661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.142181 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-deee889e-c520-4abb-a1cb-4e9c0ca22661 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:07.143446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-deee889e-c520-4abb-a1cb-4e9c0ca22661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.209451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1429/2842] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:07.218709 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc1a26-d8bf-4dec-ada9-58f38fe3984e None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.218991 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc1a26-d8bf-4dec-ada9-58f38fe3984e None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.219261 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc1a26-d8bf-4dec-ada9-58f38fe3984e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.241896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-88fc1a26-d8bf-4dec-ada9-58f38fe3984e None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:07.243093 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-88fc1a26-d8bf-4dec-ada9-58f38fe3984e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.251543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1414/2843] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:07.255872 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee889e-c520-4abb-a1cb-4e9c0ca22661 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.265484 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee889e-c520-4abb-a1cb-4e9c0ca22661 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.270155 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c186528-2ccb-4e21-a4e0-7eb5b2369cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.270753 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c186528-2ccb-4e21-a4e0-7eb5b2369cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.271038 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c186528-2ccb-4e21-a4e0-7eb5b2369cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.271723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c186528-2ccb-4e21-a4e0-7eb5b2369cf2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.272378 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c186528-2ccb-4e21-a4e0-7eb5b2369cf2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:07.272686 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c186528-2ccb-4e21-a4e0-7eb5b2369cf2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.274262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c186528-2ccb-4e21-a4e0-7eb5b2369cf2 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.285525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1430/2844] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:07.290470 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc1a26-d8bf-4dec-ada9-58f38fe3984e None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.300095 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc1a26-d8bf-4dec-ada9-58f38fe3984e None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.305678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db5084-8158-4e0e-b517-7f4a3bdd7ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.306282 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db5084-8158-4e0e-b517-7f4a3bdd7ba4 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.306562 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db5084-8158-4e0e-b517-7f4a3bdd7ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.306837 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3db5084-8158-4e0e-b517-7f4a3bdd7ba4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.307480 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db5084-8158-4e0e-b517-7f4a3bdd7ba4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.309434 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3db5084-8158-4e0e-b517-7f4a3bdd7ba4 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.432202 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1415/2845] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:07 2022] POST /identity/v3/projects => generated 369 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:07.436448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c186528-2ccb-4e21-a4e0-7eb5b2369cf2 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.447203 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c186528-2ccb-4e21-a4e0-7eb5b2369cf2 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.477800 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:07.504707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db5084-8158-4e0e-b517-7f4a3bdd7ba4 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.506401 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-a3db5084-8158-4e0e-b517-7f4a3bdd7ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.509397 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c5204-9454-4163-86d4-de3f1dc85bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.510027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5204-9454-4163-86d4-de3f1dc85bb9 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.510315 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5204-9454-4163-86d4-de3f1dc85bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.510585 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991c5204-9454-4163-86d4-de3f1dc85bb9 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.511607 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c5204-9454-4163-86d4-de3f1dc85bb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.514116 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991c5204-9454-4163-86d4-de3f1dc85bb9 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.562834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3db5084-8158-4e0e-b517-7f4a3bdd7ba4 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.566513 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d28b-fc41-48f1-8d78-ddc02325631b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.567171 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d28b-fc41-48f1-8d78-ddc02325631b service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.567446 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d28b-fc41-48f1-8d78-ddc02325631b service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.567760 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf41d28b-fc41-48f1-8d78-ddc02325631b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.569545 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-cf41d28b-fc41-48f1-8d78-ddc02325631b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.613356 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1431/2846] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:07 2022] POST /identity/v3/users => generated 285 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:07.617663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c5204-9454-4163-86d4-de3f1dc85bb9 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.628980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991c5204-9454-4163-86d4-de3f1dc85bb9 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.634190 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d71b06-dce9-4da5-8e0c-184202217076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.634828 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d71b06-dce9-4da5-8e0c-184202217076 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.639580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d71b06-dce9-4da5-8e0c-184202217076 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.639580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d71b06-dce9-4da5-8e0c-184202217076 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.639580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d71b06-dce9-4da5-8e0c-184202217076 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.639580 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d71b06-dce9-4da5-8e0c-184202217076 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.645367 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41d28b-fc41-48f1-8d78-ddc02325631b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.647366 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf41d28b-fc41-48f1-8d78-ddc02325631b service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.649235 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1432/2847] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:07.653053 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d71b06-dce9-4da5-8e0c-184202217076 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.658824 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1416/2848] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:07.663427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d71b06-dce9-4da5-8e0c-184202217076 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.668209 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cc438-954f-4add-a9e3-b8272d294b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.668802 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc438-954f-4add-a9e3-b8272d294b54 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.669088 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc438-954f-4add-a9e3-b8272d294b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.669363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc438-954f-4add-a9e3-b8272d294b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.670008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cc438-954f-4add-a9e3-b8272d294b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.671731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cc438-954f-4add-a9e3-b8272d294b54 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.681885 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1433/2849] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:07.686038 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d28b-fc41-48f1-8d78-ddc02325631b service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.696231 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf41d28b-fc41-48f1-8d78-ddc02325631b service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.701641 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ccd16-bbb9-4414-8ea7-eb9662b8b8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.702307 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ccd16-bbb9-4414-8ea7-eb9662b8b8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.702591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ccd16-bbb9-4414-8ea7-eb9662b8b8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.702870 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ccd16-bbb9-4414-8ea7-eb9662b8b8f5 admin admin] PATH_INFO: `/v3/projects/b74e532bcbe1411bba90c290d61908d8/users/f5fb62a1249a4b22b41cb46b577e51f4/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.718779 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ccd16-bbb9-4414-8ea7-eb9662b8b8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b74e532bcbe1411bba90c290d61908d8, user_id=f5fb62a1249a4b22b41cb46b577e51f4, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.721548 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ccd16-bbb9-4414-8ea7-eb9662b8b8f5 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:07.784996 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1417/2850] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:07 2022] PUT /identity/v3/projects/b74e532bcbe1411bba90c290d61908d8/users/f5fb62a1249a4b22b41cb46b577e51f4/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:07.796525 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25febcf-b196-4d49-9e7e-e24f1929b88e None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.796999 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25febcf-b196-4d49-9e7e-e24f1929b88e None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.798561 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25febcf-b196-4d49-9e7e-e24f1929b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.824747 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d25febcf-b196-4d49-9e7e-e24f1929b88e None None] MFA Rules not processed for user `f5fb62a1249a4b22b41cb46b577e51f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:07.826244 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d25febcf-b196-4d49-9e7e-e24f1929b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:07.891864 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1434/2851] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:07.896915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ccd16-bbb9-4414-8ea7-eb9662b8b8f5 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:07.901348 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:07.956826 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ccd16-bbb9-4414-8ea7-eb9662b8b8f5 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:07.962071 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedcd5f-c14a-4664-88f6-8ac3afb695aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:07.962674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedcd5f-c14a-4664-88f6-8ac3afb695aa admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:07.962953 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedcd5f-c14a-4664-88f6-8ac3afb695aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:07.963229 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedcd5f-c14a-4664-88f6-8ac3afb695aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:07.963896 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedcd5f-c14a-4664-88f6-8ac3afb695aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:07.965776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fedcd5f-c14a-4664-88f6-8ac3afb695aa admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.105500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1418/2852] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:07 2022] POST /identity/v3/projects => generated 367 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:08.109308 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25febcf-b196-4d49-9e7e-e24f1929b88e None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.120127 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25febcf-b196-4d49-9e7e-e24f1929b88e None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.172677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618ae01-d230-46a0-a380-e38d2d0dab17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.173288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ae01-d230-46a0-a380-e38d2d0dab17 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.173524 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ae01-d230-46a0-a380-e38d2d0dab17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.173792 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b618ae01-d230-46a0-a380-e38d2d0dab17 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.174406 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618ae01-d230-46a0-a380-e38d2d0dab17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:08.176328 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b618ae01-d230-46a0-a380-e38d2d0dab17 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.264549 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1435/2853] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:08 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:08.268765 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedcd5f-c14a-4664-88f6-8ac3afb695aa admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.279083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedcd5f-c14a-4664-88f6-8ac3afb695aa admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.283895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195757f-4ab9-4bfc-95ba-57bd07a3d232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.284488 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195757f-4ab9-4bfc-95ba-57bd07a3d232 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.284766 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195757f-4ab9-4bfc-95ba-57bd07a3d232 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.285039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195757f-4ab9-4bfc-95ba-57bd07a3d232 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.285674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195757f-4ab9-4bfc-95ba-57bd07a3d232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:08.287296 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195757f-4ab9-4bfc-95ba-57bd07a3d232 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.298322 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1419/2854] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:08.301981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618ae01-d230-46a0-a380-e38d2d0dab17 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.312330 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b618ae01-d230-46a0-a380-e38d2d0dab17 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.316834 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a1e85-861d-47ef-82b9-6d4befefc3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.317465 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a1e85-861d-47ef-82b9-6d4befefc3bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.317746 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a1e85-861d-47ef-82b9-6d4befefc3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.318021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06a1e85-861d-47ef-82b9-6d4befefc3bc admin admin] PATH_INFO: `/v3/projects/872a0f6921924c2394572027ed1da5fa/users/01ab6e0351624f33b25843c2ec8d426b/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.330495 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:08.333424 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a1e85-861d-47ef-82b9-6d4befefc3bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=872a0f6921924c2394572027ed1da5fa, user_id=01ab6e0351624f33b25843c2ec8d426b, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:08.336089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06a1e85-861d-47ef-82b9-6d4befefc3bc admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.431413 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1436/2855] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:08 2022] PUT /identity/v3/projects/872a0f6921924c2394572027ed1da5fa/users/01ab6e0351624f33b25843c2ec8d426b/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:08.435435 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195757f-4ab9-4bfc-95ba-57bd07a3d232 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.445920 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195757f-4ab9-4bfc-95ba-57bd07a3d232 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.501200 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d152b784-2129-4f48-af8d-b2aa341bc4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.501816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b784-2129-4f48-af8d-b2aa341bc4e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.502100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b784-2129-4f48-af8d-b2aa341bc4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.502375 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b784-2129-4f48-af8d-b2aa341bc4e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.503020 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152b784-2129-4f48-af8d-b2aa341bc4e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:08.504678 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d152b784-2129-4f48-af8d-b2aa341bc4e0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.514972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1420/2856] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:08 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:08.519033 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a1e85-861d-47ef-82b9-6d4befefc3bc admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.529293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06a1e85-861d-47ef-82b9-6d4befefc3bc admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.533863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b4351-7f60-4eb2-be31-f14b80caeab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.534503 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b4351-7f60-4eb2-be31-f14b80caeab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.534786 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b4351-7f60-4eb2-be31-f14b80caeab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.535063 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2b4351-7f60-4eb2-be31-f14b80caeab1 admin admin] PATH_INFO: `/v3/projects/872a0f6921924c2394572027ed1da5fa/users/01ab6e0351624f33b25843c2ec8d426b/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.537488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b4351-7f60-4eb2-be31-f14b80caeab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=872a0f6921924c2394572027ed1da5fa, user_id=01ab6e0351624f33b25843c2ec8d426b, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:08.540153 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2b4351-7f60-4eb2-be31-f14b80caeab1 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.550131 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1437/2857] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:08 2022] PUT /identity/v3/projects/872a0f6921924c2394572027ed1da5fa/users/01ab6e0351624f33b25843c2ec8d426b/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:08.560827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b2e58-de1f-4e80-8aef-fb0ac1679251 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.561113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b2e58-de1f-4e80-8aef-fb0ac1679251 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.561391 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0b2e58-de1f-4e80-8aef-fb0ac1679251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.589076 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-5d0b2e58-de1f-4e80-8aef-fb0ac1679251 None None] MFA Rules not processed for user `01ab6e0351624f33b25843c2ec8d426b`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:08.590284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5d0b2e58-de1f-4e80-8aef-fb0ac1679251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.652689 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:08.657769 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1421/2858] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:08.669659 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b4351-7f60-4eb2-be31-f14b80caeab1 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.671355 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ff2b4351-7f60-4eb2-be31-f14b80caeab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.727359 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2b4351-7f60-4eb2-be31-f14b80caeab1 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.730953 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d421de-e5f9-4b47-9bad-eadef8af4f1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.731564 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d421de-e5f9-4b47-9bad-eadef8af4f1f service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.731887 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d421de-e5f9-4b47-9bad-eadef8af4f1f service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.732161 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d421de-e5f9-4b47-9bad-eadef8af4f1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.741567 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d421de-e5f9-4b47-9bad-eadef8af4f1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:08.742978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d421de-e5f9-4b47-9bad-eadef8af4f1f service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.752093 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1438/2859] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:08.842482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b2e58-de1f-4e80-8aef-fb0ac1679251 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.843905 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5d0b2e58-de1f-4e80-8aef-fb0ac1679251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.862925 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d421de-e5f9-4b47-9bad-eadef8af4f1f service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:08.864454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-a8d421de-e5f9-4b47-9bad-eadef8af4f1f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.876200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d421de-e5f9-4b47-9bad-eadef8af4f1f service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.879886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487fcf-11df-4dc5-af07-4539be6d6f98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.880483 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487fcf-11df-4dc5-af07-4539be6d6f98 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.880780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487fcf-11df-4dc5-af07-4539be6d6f98 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.881051 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6487fcf-11df-4dc5-af07-4539be6d6f98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.904334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0b2e58-de1f-4e80-8aef-fb0ac1679251 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:08.908173 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4b806-1feb-4a6c-b250-d914af66f791 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:08.908787 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4b806-1feb-4a6c-b250-d914af66f791 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:08.909065 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4b806-1feb-4a6c-b250-d914af66f791 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:08.909338 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4b806-1feb-4a6c-b250-d914af66f791 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:08.911039 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1df4b806-1feb-4a6c-b250-d914af66f791 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:08.939845 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6487fcf-11df-4dc5-af07-4539be6d6f98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:08.941286 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6487fcf-11df-4dc5-af07-4539be6d6f98 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.950354 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1439/2860] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:08.984594 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4b806-1feb-4a6c-b250-d914af66f791 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:08.986010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4b806-1feb-4a6c-b250-d914af66f791 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:08.997263 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1422/2861] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:13.743448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487fcf-11df-4dc5-af07-4539be6d6f98 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:13.810160 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6487fcf-11df-4dc5-af07-4539be6d6f98 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:13.821166 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:13.821789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:13.822067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:13.822339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] PATH_INFO: `/v3/users/f5fb62a1249a4b22b41cb46b577e51f4` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:13.823647 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5fb62a1249a4b22b41cb46b577e51f4)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:13.827861 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:13.847361 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:13.991839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5fb62a1249a4b22b41cb46b577e51f4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:13.999185 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5fb62a1249a4b22b41cb46b577e51f4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:13.999906 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5fb62a1249a4b22b41cb46b577e51f4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:14.000531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5fb62a1249a4b22b41cb46b577e51f4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:14.058530 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5fb62a1249a4b22b41cb46b577e51f4'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:14.075653 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1440/2862] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:13 2022] DELETE /identity/v3/users/f5fb62a1249a4b22b41cb46b577e51f4 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:14.080189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfcf4d-bb31-4874-87b0-d1e5d19eaf3d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:14.080668 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfcf4d-bb31-4874-87b0-d1e5d19eaf3d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:14.080790 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cfcf4d-bb31-4874-87b0-d1e5d19eaf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:14.100400 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-b9cfcf4d-bb31-4874-87b0-d1e5d19eaf3d None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:14.101582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b9cfcf4d-bb31-4874-87b0-d1e5d19eaf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:14.162803 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1423/2863] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:14.172423 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:14.174568 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:14.229752 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c2eeb-6d38-43af-9d6a-5ea992720425 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:14.233363 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415549e5-52c2-42d2-bb67-59022433409c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:14.233943 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415549e5-52c2-42d2-bb67-59022433409c service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:14.234218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415549e5-52c2-42d2-bb67-59022433409c service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:14.234506 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415549e5-52c2-42d2-bb67-59022433409c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:14.243174 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415549e5-52c2-42d2-bb67-59022433409c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:14.244669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415549e5-52c2-42d2-bb67-59022433409c service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:14.253832 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1441/2864] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:14.632205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfcf4d-bb31-4874-87b0-d1e5d19eaf3d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:14.633704 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-b9cfcf4d-bb31-4874-87b0-d1e5d19eaf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:14.646072 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cfcf4d-bb31-4874-87b0-d1e5d19eaf3d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:14.652225 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:14.652871 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:14.660055 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:14.660360 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] PATH_INFO: `/v3/projects/b74e532bcbe1411bba90c290d61908d8` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:14.661563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b74e532bcbe1411bba90c290d61908d8)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:14.663536 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:14.758943 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:14.768280 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b74e532bcbe1411bba90c290d61908d8', 'request_id': 'req-6b81d021-2406-4a01-a893-9aedcd680d29'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:14.869854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b74e532bcbe1411bba90c290d61908d8', 'request_id': 'req-6b81d021-2406-4a01-a893-9aedcd680d29'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:14.876989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b74e532bcbe1411bba90c290d61908d8', 'request_id': 'req-6b81d021-2406-4a01-a893-9aedcd680d29'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:14.889067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] The token cache is being invalidate because project b74e532bcbe1411bba90c290d61908d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:14.889477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:14.890234 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:14.892196 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1424/2865] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:14 2022] DELETE /identity/v3/projects/b74e532bcbe1411bba90c290d61908d8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:14.895900 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415549e5-52c2-42d2-bb67-59022433409c service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:14.905742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415549e5-52c2-42d2-bb67-59022433409c service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:14.965831 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:14.966520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:14.966803 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:14.967074 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] PATH_INFO: `/v3/users/01ab6e0351624f33b25843c2ec8d426b` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:14.968216 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ab6e0351624f33b25843c2ec8d426b)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:14.970129 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:15.138541 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:15.141055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ab6e0351624f33b25843c2ec8d426b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.147641 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ab6e0351624f33b25843c2ec8d426b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.148294 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ab6e0351624f33b25843c2ec8d426b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.148954 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ab6e0351624f33b25843c2ec8d426b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.235430 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-a20b11e4-dabe-403c-ae43-72750ccf4392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ab6e0351624f33b25843c2ec8d426b'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.253188 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1442/2866] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:14 2022] DELETE /identity/v3/users/01ab6e0351624f33b25843c2ec8d426b => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:15.636933 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:15.638465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:15.652103 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b81d021-2406-4a01-a893-9aedcd680d29 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:15.711218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:15.711917 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:15.712198 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:15.712473 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] PATH_INFO: `/v3/projects/872a0f6921924c2394572027ed1da5fa` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:15.713595 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=872a0f6921924c2394572027ed1da5fa)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:15.715481 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:15.829627 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872a0f6921924c2394572027ed1da5fa', 'request_id': 'req-646b1002-598b-4ecc-89a4-80e3de2f8c7d'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.893083 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872a0f6921924c2394572027ed1da5fa', 'request_id': 'req-646b1002-598b-4ecc-89a4-80e3de2f8c7d'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.900108 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872a0f6921924c2394572027ed1da5fa', 'request_id': 'req-646b1002-598b-4ecc-89a4-80e3de2f8c7d'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.910462 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] The token cache is being invalidate because project 872a0f6921924c2394572027ed1da5fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:15.910690 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.911314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-646b1002-598b-4ecc-89a4-80e3de2f8c7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:15.913389 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1425/2867] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:15 2022] DELETE /identity/v3/projects/872a0f6921924c2394572027ed1da5fa => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:15.918213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dda4e4-ed3f-411c-a596-f275a7a98f61 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:15.918707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dda4e4-ed3f-411c-a596-f275a7a98f61 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:15.918816 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dda4e4-ed3f-411c-a596-f275a7a98f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:15.938460 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-24dda4e4-ed3f-411c-a596-f275a7a98f61 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:15.941627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-24dda4e4-ed3f-411c-a596-f275a7a98f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:15.999178 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1443/2868] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:16.061983 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66ee5-7695-4595-a9bd-54915207a913 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.062272 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66ee5-7695-4595-a9bd-54915207a913 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.062556 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66ee5-7695-4595-a9bd-54915207a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.083306 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-d9d66ee5-7695-4595-a9bd-54915207a913 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:16.085133 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d9d66ee5-7695-4595-a9bd-54915207a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:16.093209 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1426/2869] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:16.097496 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dda4e4-ed3f-411c-a596-f275a7a98f61 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:16.107134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dda4e4-ed3f-411c-a596-f275a7a98f61 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:16.111789 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b38dd-7b1f-4431-858f-313dfc7b319d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:16.112384 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b38dd-7b1f-4431-858f-313dfc7b319d admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.112665 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b38dd-7b1f-4431-858f-313dfc7b319d admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.112942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352b38dd-7b1f-4431-858f-313dfc7b319d admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.113586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b38dd-7b1f-4431-858f-313dfc7b319d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:16.113886 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b38dd-7b1f-4431-858f-313dfc7b319d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:16.115551 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352b38dd-7b1f-4431-858f-313dfc7b319d admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:16.127139 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1444/2870] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:16.132045 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66ee5-7695-4595-a9bd-54915207a913 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:16.141358 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66ee5-7695-4595-a9bd-54915207a913 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:16.146094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ca900-5d4c-4f6e-ad77-22418451ddbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:16.147250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ca900-5d4c-4f6e-ad77-22418451ddbd admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.147566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ca900-5d4c-4f6e-ad77-22418451ddbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.147845 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13ca900-5d4c-4f6e-ad77-22418451ddbd admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.148482 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ca900-5d4c-4f6e-ad77-22418451ddbd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:16.150432 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13ca900-5d4c-4f6e-ad77-22418451ddbd admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:16.237206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1427/2871] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:16 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:16.241993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b38dd-7b1f-4431-858f-313dfc7b319d admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:16.251889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352b38dd-7b1f-4431-858f-313dfc7b319d admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:16.305790 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af471-03d3-4b5f-a538-0ba4df9c18d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:16.306385 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af471-03d3-4b5f-a538-0ba4df9c18d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.306663 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af471-03d3-4b5f-a538-0ba4df9c18d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.306936 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533af471-03d3-4b5f-a538-0ba4df9c18d6 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.307593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533af471-03d3-4b5f-a538-0ba4df9c18d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:16.309488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533af471-03d3-4b5f-a538-0ba4df9c18d6 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:16.424893 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1445/2872] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:16 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:16.428836 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ca900-5d4c-4f6e-ad77-22418451ddbd admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:16.438932 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13ca900-5d4c-4f6e-ad77-22418451ddbd admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:16.443940 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b302b-cf96-497e-93a0-6c775efae337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:16.444547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b302b-cf96-497e-93a0-6c775efae337 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.444827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b302b-cf96-497e-93a0-6c775efae337 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.445098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7b302b-cf96-497e-93a0-6c775efae337 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.445912 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b302b-cf96-497e-93a0-6c775efae337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:16.457957 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7b302b-cf96-497e-93a0-6c775efae337 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:16.458247 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1428/2873] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:16.462761 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af471-03d3-4b5f-a538-0ba4df9c18d6 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:16.472783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533af471-03d3-4b5f-a538-0ba4df9c18d6 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:16.478256 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5abd0-85dd-4cbf-9488-81b78d1076c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:16.478852 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5abd0-85dd-4cbf-9488-81b78d1076c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.479134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5abd0-85dd-4cbf-9488-81b78d1076c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.479410 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5abd0-85dd-4cbf-9488-81b78d1076c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.480123 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5abd0-85dd-4cbf-9488-81b78d1076c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:16.481846 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc5abd0-85dd-4cbf-9488-81b78d1076c8 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:16.492622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1446/2874] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:16.496987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b302b-cf96-497e-93a0-6c775efae337 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:16.506867 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7b302b-cf96-497e-93a0-6c775efae337 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:16.511437 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071e0eb-1678-41e6-b0eb-413afa4c3d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:16.512114 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071e0eb-1678-41e6-b0eb-413afa4c3d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.512392 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071e0eb-1678-41e6-b0eb-413afa4c3d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.512666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071e0eb-1678-41e6-b0eb-413afa4c3d82 admin admin] PATH_INFO: `/v3/projects/56722c9915d343199895ed0c3b5c7d77/users/a43f6d70e418490ca6f7a2552e9dbfe3/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.524098 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:16.528029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071e0eb-1678-41e6-b0eb-413afa4c3d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56722c9915d343199895ed0c3b5c7d77, user_id=a43f6d70e418490ca6f7a2552e9dbfe3, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:16.530649 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071e0eb-1678-41e6-b0eb-413afa4c3d82 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:16.630445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1429/2875] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:16 2022] PUT /identity/v3/projects/56722c9915d343199895ed0c3b5c7d77/users/a43f6d70e418490ca6f7a2552e9dbfe3/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:16.640366 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b0bf7-33c7-4815-892e-3a7864428abe None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.640654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b0bf7-33c7-4815-892e-3a7864428abe None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.640931 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b0bf7-33c7-4815-892e-3a7864428abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.668923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-b62b0bf7-33c7-4815-892e-3a7864428abe None None] MFA Rules not processed for user `a43f6d70e418490ca6f7a2552e9dbfe3`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:16.670125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-b62b0bf7-33c7-4815-892e-3a7864428abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:16.682684 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:16.732994 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1447/2876] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:16.737732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071e0eb-1678-41e6-b0eb-413afa4c3d82 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:16.798569 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071e0eb-1678-41e6-b0eb-413afa4c3d82 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:16.803529 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37075e35-5a3c-48f2-862e-c240f03e3cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:16.804143 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37075e35-5a3c-48f2-862e-c240f03e3cbc admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.804425 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37075e35-5a3c-48f2-862e-c240f03e3cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.804702 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37075e35-5a3c-48f2-862e-c240f03e3cbc admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.805345 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37075e35-5a3c-48f2-862e-c240f03e3cbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:16.807250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37075e35-5a3c-48f2-862e-c240f03e3cbc admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:16.876773 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1430/2877] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:16 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 04 09:02:16.881633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b0bf7-33c7-4815-892e-3a7864428abe None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:16.892306 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b0bf7-33c7-4815-892e-3a7864428abe None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:16.947376 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2317b19-e9ad-4484-9320-4dbe9cf0e678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:16.948052 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2317b19-e9ad-4484-9320-4dbe9cf0e678 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:16.948288 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2317b19-e9ad-4484-9320-4dbe9cf0e678 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:16.948560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2317b19-e9ad-4484-9320-4dbe9cf0e678 admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:16.949229 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2317b19-e9ad-4484-9320-4dbe9cf0e678 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:16.951398 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2317b19-e9ad-4484-9320-4dbe9cf0e678 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:17.012569 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1448/2878] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:16 2022] POST /identity/v3/users => generated 297 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:17.016666 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37075e35-5a3c-48f2-862e-c240f03e3cbc admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:17.027525 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37075e35-5a3c-48f2-862e-c240f03e3cbc admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:17.032256 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37da54-80cc-492b-8977-be6b9813de3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:17.032849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37da54-80cc-492b-8977-be6b9813de3f admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:17.033131 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37da54-80cc-492b-8977-be6b9813de3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:17.033408 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37da54-80cc-492b-8977-be6b9813de3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:17.034054 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37da54-80cc-492b-8977-be6b9813de3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:17.035670 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37da54-80cc-492b-8977-be6b9813de3f admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:17.045997 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1431/2879] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:17.050105 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2317b19-e9ad-4484-9320-4dbe9cf0e678 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:17.060000 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2317b19-e9ad-4484-9320-4dbe9cf0e678 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:17.064519 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da266f0-3021-440d-a256-249798c16b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:17.065147 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da266f0-3021-440d-a256-249798c16b6b admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:17.065427 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da266f0-3021-440d-a256-249798c16b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:17.065699 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da266f0-3021-440d-a256-249798c16b6b admin admin] PATH_INFO: `/v3/projects/3ddc97d76f2440038e9956784a694576/users/d81a3066a0ac49fabefbbde006f4ff00/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:17.080921 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da266f0-3021-440d-a256-249798c16b6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddc97d76f2440038e9956784a694576, user_id=d81a3066a0ac49fabefbbde006f4ff00, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:17.084211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da266f0-3021-440d-a256-249798c16b6b admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:17.132851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1449/2880] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:17 2022] PUT /identity/v3/projects/3ddc97d76f2440038e9956784a694576/users/d81a3066a0ac49fabefbbde006f4ff00/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:17.136834 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37da54-80cc-492b-8977-be6b9813de3f admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:17.146656 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37da54-80cc-492b-8977-be6b9813de3f admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:17.203257 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e1d388-d98a-4383-9ab5-2e6386a1aa81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:17.203899 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d388-d98a-4383-9ab5-2e6386a1aa81 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:17.204178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d388-d98a-4383-9ab5-2e6386a1aa81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:17.204455 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e1d388-d98a-4383-9ab5-2e6386a1aa81 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:17.205100 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1d388-d98a-4383-9ab5-2e6386a1aa81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:17.206679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e1d388-d98a-4383-9ab5-2e6386a1aa81 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:17.220030 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1432/2881] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:17.220970 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da266f0-3021-440d-a256-249798c16b6b admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:17.231243 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da266f0-3021-440d-a256-249798c16b6b admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:17.235947 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd33f6-3867-48a6-aa91-fd6909b2aa92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:17.236597 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd33f6-3867-48a6-aa91-fd6909b2aa92 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:17.236875 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd33f6-3867-48a6-aa91-fd6909b2aa92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:17.237151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd33f6-3867-48a6-aa91-fd6909b2aa92 admin admin] PATH_INFO: `/v3/projects/3ddc97d76f2440038e9956784a694576/users/d81a3066a0ac49fabefbbde006f4ff00/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:17.239056 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd33f6-3867-48a6-aa91-fd6909b2aa92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ddc97d76f2440038e9956784a694576, user_id=d81a3066a0ac49fabefbbde006f4ff00, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:17.242210 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cd33f6-3867-48a6-aa91-fd6909b2aa92 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:17.252708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1450/2882] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:17 2022] PUT /identity/v3/projects/3ddc97d76f2440038e9956784a694576/users/d81a3066a0ac49fabefbbde006f4ff00/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:17.264816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8680b-f595-47bf-9ccb-300b8eb7c51b None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:17.265101 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8680b-f595-47bf-9ccb-300b8eb7c51b None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:17.266335 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8680b-f595-47bf-9ccb-300b8eb7c51b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:17.295486 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-16a8680b-f595-47bf-9ccb-300b8eb7c51b None None] MFA Rules not processed for user `d81a3066a0ac49fabefbbde006f4ff00`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:17.296726 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-16a8680b-f595-47bf-9ccb-300b8eb7c51b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:17.348864 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:17.367942 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1433/2883] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:17 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:17.378687 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd33f6-3867-48a6-aa91-fd6909b2aa92 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:17.380393 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-69cd33f6-3867-48a6-aa91-fd6909b2aa92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:17.436705 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cd33f6-3867-48a6-aa91-fd6909b2aa92 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:17.440382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a8ce-104e-49a6-b21d-47fcefd48399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:17.440981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464a8ce-104e-49a6-b21d-47fcefd48399 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:17.441267 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464a8ce-104e-49a6-b21d-47fcefd48399 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:17.441545 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2464a8ce-104e-49a6-b21d-47fcefd48399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:17.452084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464a8ce-104e-49a6-b21d-47fcefd48399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:17.453448 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2464a8ce-104e-49a6-b21d-47fcefd48399 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:17.462862 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1451/2884] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:17 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:17.564816 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8680b-f595-47bf-9ccb-300b8eb7c51b None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:17.575079 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8680b-f595-47bf-9ccb-300b8eb7c51b None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:17.578629 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c443fa-e6aa-4ad5-9d59-1b37041265bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:17.579226 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c443fa-e6aa-4ad5-9d59-1b37041265bf service cinder] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:17.579519 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c443fa-e6aa-4ad5-9d59-1b37041265bf service cinder] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:17.579801 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c443fa-e6aa-4ad5-9d59-1b37041265bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:17.634526 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c443fa-e6aa-4ad5-9d59-1b37041265bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:17.635978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c443fa-e6aa-4ad5-9d59-1b37041265bf service cinder] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:17.644617 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1434/2885] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:17.798259 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a8ce-104e-49a6-b21d-47fcefd48399 service cinder] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:17.799683 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-2464a8ce-104e-49a6-b21d-47fcefd48399 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:17.812618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:17.857969 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2464a8ce-104e-49a6-b21d-47fcefd48399 service cinder] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:17.862030 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a889b9-4953-4af6-9004-ac883d4921c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:17.862633 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a889b9-4953-4af6-9004-ac883d4921c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:17.862916 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a889b9-4953-4af6-9004-ac883d4921c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:17.867037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a889b9-4953-4af6-9004-ac883d4921c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:17.867037 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-f2a889b9-4953-4af6-9004-ac883d4921c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:17.874888 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a889b9-4953-4af6-9004-ac883d4921c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:17.876369 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a889b9-4953-4af6-9004-ac883d4921c3 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:17.884408 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1452/2886] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:20.636677 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c443fa-e6aa-4ad5-9d59-1b37041265bf service cinder] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:20.698221 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c443fa-e6aa-4ad5-9d59-1b37041265bf service cinder] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:20.703010 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:20.703671 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:20.703952 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:20.704227 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] PATH_INFO: `/v3/users/a43f6d70e418490ca6f7a2552e9dbfe3` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:20.705337 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a43f6d70e418490ca6f7a2552e9dbfe3)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:20.707245 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:20.884910 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a43f6d70e418490ca6f7a2552e9dbfe3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.892563 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a43f6d70e418490ca6f7a2552e9dbfe3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.904185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a43f6d70e418490ca6f7a2552e9dbfe3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:20.904185 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a43f6d70e418490ca6f7a2552e9dbfe3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.035230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a43f6d70e418490ca6f7a2552e9dbfe3'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.054305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1435/2887] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:20 2022] DELETE /identity/v3/users/a43f6d70e418490ca6f7a2552e9dbfe3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:21.058787 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e86e-1a1f-4f3e-adff-84cd835c7b9f None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.059273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e86e-1a1f-4f3e-adff-84cd835c7b9f None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.059409 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657e86e-1a1f-4f3e-adff-84cd835c7b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.079843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-d657e86e-1a1f-4f3e-adff-84cd835c7b9f None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:21.081069 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d657e86e-1a1f-4f3e-adff-84cd835c7b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.145851 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1453/2888] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:21.151378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.152926 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.158582 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:21.210805 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e428a62-258a-459e-bc12-7e4810545f1c admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.214682 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d0fb1-904a-4a61-a60e-abb7e7f823e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.215679 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d0fb1-904a-4a61-a60e-abb7e7f823e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.216034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d0fb1-904a-4a61-a60e-abb7e7f823e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.216382 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d0fb1-904a-4a61-a60e-abb7e7f823e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.232934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d0fb1-904a-4a61-a60e-abb7e7f823e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.232934 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d0fb1-904a-4a61-a60e-abb7e7f823e2 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.242324 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1436/2889] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:21.319640 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e86e-1a1f-4f3e-adff-84cd835c7b9f None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.321184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d657e86e-1a1f-4f3e-adff-84cd835c7b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.334631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657e86e-1a1f-4f3e-adff-84cd835c7b9f None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.338991 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.339662 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.340012 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.340357 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.342725 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.352791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.354325 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.362596 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1454/2890] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:21.444465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d0fb1-904a-4a61-a60e-abb7e7f823e2 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.455380 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d0fb1-904a-4a61-a60e-abb7e7f823e2 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.459915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.460351 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.460626 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.460887 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.475552 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.551063 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.552553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.563821 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1437/2891] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 04 09:02:21.629923 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.632005 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.642507 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.644112 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.662835 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d1d29-575f-4e87-b007-d992b8b07ab2 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.668770 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.669419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.669696 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.669972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] PATH_INFO: `/v3/projects/56722c9915d343199895ed0c3b5c7d77` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.671149 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56722c9915d343199895ed0c3b5c7d77)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.673193 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.706765 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc38cb5d-8d4b-49a7-b8d1-2e152a6e5f92 service neutron] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.712237 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af4400-cdb8-49ef-8925-ff1ff542e6a8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.712869 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af4400-cdb8-49ef-8925-ff1ff542e6a8 service placement] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.713154 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af4400-cdb8-49ef-8925-ff1ff542e6a8 service placement] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.713432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af4400-cdb8-49ef-8925-ff1ff542e6a8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.715198 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-43af4400-cdb8-49ef-8925-ff1ff542e6a8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:21.727134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af4400-cdb8-49ef-8925-ff1ff542e6a8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.728748 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af4400-cdb8-49ef-8925-ff1ff542e6a8 service placement] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:21.738870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1455/2892] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:21.762168 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56722c9915d343199895ed0c3b5c7d77', 'request_id': 'req-57995763-5e20-40f9-984c-d03abdb64ee0'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.812250 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56722c9915d343199895ed0c3b5c7d77', 'request_id': 'req-57995763-5e20-40f9-984c-d03abdb64ee0'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.819947 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56722c9915d343199895ed0c3b5c7d77', 'request_id': 'req-57995763-5e20-40f9-984c-d03abdb64ee0'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.830968 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] The token cache is being invalidate because project 56722c9915d343199895ed0c3b5c7d77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:21.831764 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.832491 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:21.834146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1438/2893] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:21 2022] DELETE /identity/v3/projects/56722c9915d343199895ed0c3b5c7d77 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:21.838170 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af4400-cdb8-49ef-8925-ff1ff542e6a8 service placement] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:21.848648 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af4400-cdb8-49ef-8925-ff1ff542e6a8 service placement] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:21.877654 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=100 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:21.906714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:21.906714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:21.906714 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:21.907110 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] PATH_INFO: `/v3/users/d81a3066a0ac49fabefbbde006f4ff00` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:21.908001 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d81a3066a0ac49fabefbbde006f4ff00)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:21.909919 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.060213 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd81a3066a0ac49fabefbbde006f4ff00'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.067066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd81a3066a0ac49fabefbbde006f4ff00'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.067811 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd81a3066a0ac49fabefbbde006f4ff00'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.068588 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd81a3066a0ac49fabefbbde006f4ff00'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.126889 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-0d2eec79-5ec2-41e7-bab0-75e856d563f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd81a3066a0ac49fabefbbde006f4ff00'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.144456 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1456/2894] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:21 2022] DELETE /identity/v3/users/d81a3066a0ac49fabefbbde006f4ff00 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:22.601638 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:22.603059 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:22.619053 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57995763-5e20-40f9-984c-d03abdb64ee0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:22.631347 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:22.681113 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:22.681731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.681964 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.682235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] PATH_INFO: `/v3/projects/3ddc97d76f2440038e9956784a694576` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.683355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ddc97d76f2440038e9956784a694576)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:22.685492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:22.801628 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ddc97d76f2440038e9956784a694576', 'request_id': 'req-c0daae87-158d-4f8e-a108-0069d75ee2e7'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.846406 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ddc97d76f2440038e9956784a694576', 'request_id': 'req-c0daae87-158d-4f8e-a108-0069d75ee2e7'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.853243 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ddc97d76f2440038e9956784a694576', 'request_id': 'req-c0daae87-158d-4f8e-a108-0069d75ee2e7'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.863672 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] The token cache is being invalidate because project 3ddc97d76f2440038e9956784a694576 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:22.863962 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.865738 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-c0daae87-158d-4f8e-a108-0069d75ee2e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:22.866648 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1439/2895] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:22 2022] DELETE /identity/v3/projects/3ddc97d76f2440038e9956784a694576 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:22.871780 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1b6e-e3ff-4aaf-bbf6-2efce49c1eb2 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.872073 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1b6e-e3ff-4aaf-bbf6-2efce49c1eb2 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.872351 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e1b6e-e3ff-4aaf-bbf6-2efce49c1eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.891839 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-262e1b6e-e3ff-4aaf-bbf6-2efce49c1eb2 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:22.893049 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-262e1b6e-e3ff-4aaf-bbf6-2efce49c1eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:22.951870 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1457/2896] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:22.959868 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182f5e-d08b-42a2-9989-046cf3471e8c None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:22.960162 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182f5e-d08b-42a2-9989-046cf3471e8c None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:22.960445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40182f5e-d08b-42a2-9989-046cf3471e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:22.981077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-40182f5e-d08b-42a2-9989-046cf3471e8c None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:22.982560 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-40182f5e-d08b-42a2-9989-046cf3471e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:22.991502 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1440/2897] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 04 09:02:22.995811 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1b6e-e3ff-4aaf-bbf6-2efce49c1eb2 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.005502 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e1b6e-e3ff-4aaf-bbf6-2efce49c1eb2 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.010151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfbfb5-b4bf-4732-8da4-8d082a4d3d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.010743 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfbfb5-b4bf-4732-8da4-8d082a4d3d31 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.011047 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfbfb5-b4bf-4732-8da4-8d082a4d3d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.011321 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addfbfb5-b4bf-4732-8da4-8d082a4d3d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.012007 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfbfb5-b4bf-4732-8da4-8d082a4d3d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88127) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:23.012312 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfbfb5-b4bf-4732-8da4-8d082a4d3d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.013895 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addfbfb5-b4bf-4732-8da4-8d082a4d3d31 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.025043 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1458/2898] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:23.030692 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182f5e-d08b-42a2-9989-046cf3471e8c None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.040591 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40182f5e-d08b-42a2-9989-046cf3471e8c None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.045336 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0684206-d3e4-4200-8503-bd3fb556dd18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.045935 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0684206-d3e4-4200-8503-bd3fb556dd18 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.046232 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0684206-d3e4-4200-8503-bd3fb556dd18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.046509 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0684206-d3e4-4200-8503-bd3fb556dd18 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.047161 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0684206-d3e4-4200-8503-bd3fb556dd18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.049073 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0684206-d3e4-4200-8503-bd3fb556dd18 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.116575 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1441/2899] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:23 2022] POST /identity/v3/projects => generated 379 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:23.120708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfbfb5-b4bf-4732-8da4-8d082a4d3d31 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.130718 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addfbfb5-b4bf-4732-8da4-8d082a4d3d31 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.163526 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:23.186539 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f74a1-a8ab-4ea5-9234-04397341f82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.187144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f74a1-a8ab-4ea5-9234-04397341f82a admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.187425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f74a1-a8ab-4ea5-9234-04397341f82a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.187729 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f74a1-a8ab-4ea5-9234-04397341f82a admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.188401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f74a1-a8ab-4ea5-9234-04397341f82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.190784 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f74a1-a8ab-4ea5-9234-04397341f82a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.247723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1459/2900] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:23 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:23.251774 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0684206-d3e4-4200-8503-bd3fb556dd18 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.262218 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0684206-d3e4-4200-8503-bd3fb556dd18 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.267305 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c0b58-bb9f-4aaa-bf8c-19d383748261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.276477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c0b58-bb9f-4aaa-bf8c-19d383748261 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.276477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c0b58-bb9f-4aaa-bf8c-19d383748261 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.276477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c0b58-bb9f-4aaa-bf8c-19d383748261 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.276477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c0b58-bb9f-4aaa-bf8c-19d383748261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.276477 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c0b58-bb9f-4aaa-bf8c-19d383748261 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.281463 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1442/2901] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:23.285505 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f74a1-a8ab-4ea5-9234-04397341f82a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.298208 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f74a1-a8ab-4ea5-9234-04397341f82a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.303023 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad85cf-5195-4b2e-9ec4-d07d45907565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.303661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad85cf-5195-4b2e-9ec4-d07d45907565 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.303941 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad85cf-5195-4b2e-9ec4-d07d45907565 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.304211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad85cf-5195-4b2e-9ec4-d07d45907565 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.305036 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad85cf-5195-4b2e-9ec4-d07d45907565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.306693 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad85cf-5195-4b2e-9ec4-d07d45907565 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.317620 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1460/2902] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:23.321799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c0b58-bb9f-4aaa-bf8c-19d383748261 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.332214 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c0b58-bb9f-4aaa-bf8c-19d383748261 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.337368 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53577-5df8-421f-96dc-90f520b51591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.338025 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53577-5df8-421f-96dc-90f520b51591 admin admin] REQUEST_METHOD: `PUT` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.338314 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53577-5df8-421f-96dc-90f520b51591 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.338597 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c53577-5df8-421f-96dc-90f520b51591 admin admin] PATH_INFO: `/v3/projects/515832f484cd4e368803817f41127509/users/880c713f73c6420ca982dfe2ddf2a3dc/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.353421 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c53577-5df8-421f-96dc-90f520b51591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=515832f484cd4e368803817f41127509, user_id=880c713f73c6420ca982dfe2ddf2a3dc, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.374498 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c53577-5df8-421f-96dc-90f520b51591 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.539128 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1443/2903] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:23 2022] PUT /identity/v3/projects/515832f484cd4e368803817f41127509/users/880c713f73c6420ca982dfe2ddf2a3dc/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:23.558528 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae08b9-d258-4167-b554-2d22a8a38850 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.558901 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae08b9-d258-4167-b554-2d22a8a38850 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.559353 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae08b9-d258-4167-b554-2d22a8a38850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.601035 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-92ae08b9-d258-4167-b554-2d22a8a38850 None None] MFA Rules not processed for user `880c713f73c6420ca982dfe2ddf2a3dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:23.602431 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-92ae08b9-d258-4167-b554-2d22a8a38850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:23.689200 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1461/2904] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:23.694029 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53577-5df8-421f-96dc-90f520b51591 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.754426 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:23.778782 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c53577-5df8-421f-96dc-90f520b51591 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.788359 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4272a-48d5-44b0-a04d-bb511b57d329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.789047 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4272a-48d5-44b0-a04d-bb511b57d329 admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.789321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4272a-48d5-44b0-a04d-bb511b57d329 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.789592 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4272a-48d5-44b0-a04d-bb511b57d329 admin admin] PATH_INFO: `/v3/projects` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.790320 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4272a-48d5-44b0-a04d-bb511b57d329 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.792355 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4272a-48d5-44b0-a04d-bb511b57d329 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:23.875021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1444/2905] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:23 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:23.876394 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae08b9-d258-4167-b554-2d22a8a38850 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:23.887453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae08b9-d258-4167-b554-2d22a8a38850 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:23.941956 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e217bb-15e6-419c-8d4b-b209f791a18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:23.943151 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e217bb-15e6-419c-8d4b-b209f791a18a admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:23.943432 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e217bb-15e6-419c-8d4b-b209f791a18a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:23.943731 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e217bb-15e6-419c-8d4b-b209f791a18a admin admin] PATH_INFO: `/v3/users` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:23.944352 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e217bb-15e6-419c-8d4b-b209f791a18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:23.946247 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e217bb-15e6-419c-8d4b-b209f791a18a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.041084 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1462/2906] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:23 2022] POST /identity/v3/users => generated 296 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:24.044963 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4272a-48d5-44b0-a04d-bb511b57d329 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.056252 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4272a-48d5-44b0-a04d-bb511b57d329 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.061182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8b8e-d719-49b9-a36b-fa9283795841 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.061809 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8b8e-d719-49b9-a36b-fa9283795841 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.062138 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8b8e-d719-49b9-a36b-fa9283795841 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.062419 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a8b8e-d719-49b9-a36b-fa9283795841 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.063067 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a8b8e-d719-49b9-a36b-fa9283795841 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.064716 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a8b8e-d719-49b9-a36b-fa9283795841 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.075732 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1445/2907] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:24.079894 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e217bb-15e6-419c-8d4b-b209f791a18a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.090029 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e217bb-15e6-419c-8d4b-b209f791a18a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.094616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f0cb-d989-4452-9ba0-b6dead2253cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.095368 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f0cb-d989-4452-9ba0-b6dead2253cb admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.095685 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f0cb-d989-4452-9ba0-b6dead2253cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.095962 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96f0cb-d989-4452-9ba0-b6dead2253cb admin admin] PATH_INFO: `/v3/projects/e8c6b8e68bff46fcb175e85b5e3b79fe/users/6ea52348a8e34197b31b94cd8be06383/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.110940 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f0cb-d989-4452-9ba0-b6dead2253cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c6b8e68bff46fcb175e85b5e3b79fe, user_id=6ea52348a8e34197b31b94cd8be06383, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.113689 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96f0cb-d989-4452-9ba0-b6dead2253cb admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.184592 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1463/2908] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:24 2022] PUT /identity/v3/projects/e8c6b8e68bff46fcb175e85b5e3b79fe/users/6ea52348a8e34197b31b94cd8be06383/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:24.188846 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8b8e-d719-49b9-a36b-fa9283795841 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.200254 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a8b8e-d719-49b9-a36b-fa9283795841 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.257847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043ab6b-b144-4a50-999d-81ac1cbd1364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.258469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043ab6b-b144-4a50-999d-81ac1cbd1364 admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.258777 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043ab6b-b144-4a50-999d-81ac1cbd1364 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.259091 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043ab6b-b144-4a50-999d-81ac1cbd1364 admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.259776 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043ab6b-b144-4a50-999d-81ac1cbd1364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.263619 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6043ab6b-b144-4a50-999d-81ac1cbd1364 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.271378 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1446/2909] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 04 09:02:24.275703 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f0cb-d989-4452-9ba0-b6dead2253cb admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.286626 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96f0cb-d989-4452-9ba0-b6dead2253cb admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.291360 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c4568-65f5-4bc2-b4dd-fb8308f6515a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.292134 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c4568-65f5-4bc2-b4dd-fb8308f6515a admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.292447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c4568-65f5-4bc2-b4dd-fb8308f6515a admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.292720 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c4568-65f5-4bc2-b4dd-fb8308f6515a admin admin] PATH_INFO: `/v3/projects/e8c6b8e68bff46fcb175e85b5e3b79fe/users/6ea52348a8e34197b31b94cd8be06383/roles/22ae1ab040b44fca82f063e1ab912517` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.294651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c4568-65f5-4bc2-b4dd-fb8308f6515a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8c6b8e68bff46fcb175e85b5e3b79fe, user_id=6ea52348a8e34197b31b94cd8be06383, role_id=22ae1ab040b44fca82f063e1ab912517)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.297520 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c4568-65f5-4bc2-b4dd-fb8308f6515a admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.303487 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:24.308983 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1464/2910] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:24 2022] PUT /identity/v3/projects/e8c6b8e68bff46fcb175e85b5e3b79fe/users/6ea52348a8e34197b31b94cd8be06383/roles/22ae1ab040b44fca82f063e1ab912517 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:24.320961 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932601-66f6-4eac-97e0-7ce6c792d60d None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.323799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932601-66f6-4eac-97e0-7ce6c792d60d None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.323799 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932601-66f6-4eac-97e0-7ce6c792d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.349850 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-bc932601-66f6-4eac-97e0-7ce6c792d60d None None] MFA Rules not processed for user `6ea52348a8e34197b31b94cd8be06383`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:24.351077 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-bc932601-66f6-4eac-97e0-7ce6c792d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.419469 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1447/2911] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:24.430560 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c4568-65f5-4bc2-b4dd-fb8308f6515a admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:24.432262 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-478c4568-65f5-4bc2-b4dd-fb8308f6515a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:24.489172 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c4568-65f5-4bc2-b4dd-fb8308f6515a admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:24.492822 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834030c8-683a-485a-964b-e56ea27352e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:24.493425 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834030c8-683a-485a-964b-e56ea27352e0 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:24.493707 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834030c8-683a-485a-964b-e56ea27352e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:24.493980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834030c8-683a-485a-964b-e56ea27352e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:24.503217 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834030c8-683a-485a-964b-e56ea27352e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:24.505263 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834030c8-683a-485a-964b-e56ea27352e0 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:24.514917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1465/2912] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:24 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:24.992731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932601-66f6-4eac-97e0-7ce6c792d60d None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.032551 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:25.055553 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932601-66f6-4eac-97e0-7ce6c792d60d None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.060021 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.060642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.060915 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.061182 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] PATH_INFO: `/v3/users/880c713f73c6420ca982dfe2ddf2a3dc` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.062284 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=880c713f73c6420ca982dfe2ddf2a3dc)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.064543 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.225860 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '880c713f73c6420ca982dfe2ddf2a3dc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.232894 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '880c713f73c6420ca982dfe2ddf2a3dc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.233547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '880c713f73c6420ca982dfe2ddf2a3dc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.234144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '880c713f73c6420ca982dfe2ddf2a3dc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.280500 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '880c713f73c6420ca982dfe2ddf2a3dc'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:25.300861 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1448/2913] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:24 2022] DELETE /identity/v3/users/880c713f73c6420ca982dfe2ddf2a3dc => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:25.305440 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae37f-dbf7-4733-8aae-66b0e7968165 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.305944 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae37f-dbf7-4733-8aae-66b0e7968165 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.306055 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eae37f-dbf7-4733-8aae-66b0e7968165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.325402 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-68eae37f-dbf7-4733-8aae-66b0e7968165 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:25.326609 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-68eae37f-dbf7-4733-8aae-66b0e7968165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.384211 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1466/2914] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:25.394090 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.395554 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.451361 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f27047c-a9a4-4b88-b34f-2879c284f7df admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.454960 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6defb-67f2-4ce3-9963-4acd04d30109 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.455586 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6defb-67f2-4ce3-9963-4acd04d30109 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.455866 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6defb-67f2-4ce3-9963-4acd04d30109 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.456137 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf6defb-67f2-4ce3-9963-4acd04d30109 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.465178 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6defb-67f2-4ce3-9963-4acd04d30109 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.466596 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf6defb-67f2-4ce3-9963-4acd04d30109 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.476034 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1449/2915] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:25.853472 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae37f-dbf7-4733-8aae-66b0e7968165 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:25.855008 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-68eae37f-dbf7-4733-8aae-66b0e7968165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:25.868783 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eae37f-dbf7-4733-8aae-66b0e7968165 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:25.874197 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:25.874915 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:25.875097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:25.875367 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] PATH_INFO: `/v3/projects/515832f484cd4e368803817f41127509` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:25.876531 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=515832f484cd4e368803817f41127509)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:25.878591 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:25.991669 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '515832f484cd4e368803817f41127509', 'request_id': 'req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.057986 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '515832f484cd4e368803817f41127509', 'request_id': 'req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.064843 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '515832f484cd4e368803817f41127509', 'request_id': 'req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.076575 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] The token cache is being invalidate because project 515832f484cd4e368803817f41127509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:26.081479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.081479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.081479 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1467/2916] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:25 2022] DELETE /identity/v3/projects/515832f484cd4e368803817f41127509 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:26.083895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6defb-67f2-4ce3-9963-4acd04d30109 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.093504 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf6defb-67f2-4ce3-9963-4acd04d30109 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.147094 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:26.152992 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.160565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.160565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.160565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] PATH_INFO: `/v3/users/6ea52348a8e34197b31b94cd8be06383` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.160565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea52348a8e34197b31b94cd8be06383)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.160565 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.310978 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea52348a8e34197b31b94cd8be06383'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.318895 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea52348a8e34197b31b94cd8be06383'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.322151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea52348a8e34197b31b94cd8be06383'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.322151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea52348a8e34197b31b94cd8be06383'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.377334 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-f8c6080a-e098-480e-914d-7c9b39bc4fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea52348a8e34197b31b94cd8be06383'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.395831 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1450/2917] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:26 2022] DELETE /identity/v3/users/6ea52348a8e34197b31b94cd8be06383 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:26.762097 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:26.763565 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:26.777920 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb4c4a0-0bca-4a7d-a31d-783bae27e8ca admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:26.798323 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:26.835586 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:26.836144 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:26.836433 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:26.836773 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] PATH_INFO: `/v3/projects/e8c6b8e68bff46fcb175e85b5e3b79fe` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:26.837948 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8c6b8e68bff46fcb175e85b5e3b79fe)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:26.840006 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:26.932316 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8c6b8e68bff46fcb175e85b5e3b79fe', 'request_id': 'req-dc7f488e-b025-478a-a436-8f2e72743940'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.988807 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8c6b8e68bff46fcb175e85b5e3b79fe', 'request_id': 'req-dc7f488e-b025-478a-a436-8f2e72743940'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:26.996082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8c6b8e68bff46fcb175e85b5e3b79fe', 'request_id': 'req-dc7f488e-b025-478a-a436-8f2e72743940'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:27.006981 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] The token cache is being invalidate because project e8c6b8e68bff46fcb175e85b5e3b79fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:27.008917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:27.008917 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-dc7f488e-b025-478a-a436-8f2e72743940 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:27.009331 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1468/2918] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:26 2022] DELETE /identity/v3/projects/e8c6b8e68bff46fcb175e85b5e3b79fe => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:27.014195 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5535a1-f3a0-4225-bcb8-4e4bcb180f31 None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.014490 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5535a1-f3a0-4225-bcb8-4e4bcb180f31 None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.014890 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5535a1-f3a0-4225-bcb8-4e4bcb180f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.034695 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-5d5535a1-f3a0-4225-bcb8-4e4bcb180f31 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:27.035965 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-5d5535a1-f3a0-4225-bcb8-4e4bcb180f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.096817 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1451/2919] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:27.104512 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f67338-104c-4bb7-a253-3ea01c585a83 None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.104794 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f67338-104c-4bb7-a253-3ea01c585a83 None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.105066 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f67338-104c-4bb7-a253-3ea01c585a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.124517 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-56f67338-104c-4bb7-a253-3ea01c585a83 None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:27.125710 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-56f67338-104c-4bb7-a253-3ea01c585a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.134336 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1469/2920] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:27.138492 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5535a1-f3a0-4225-bcb8-4e4bcb180f31 None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.148321 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5535a1-f3a0-4225-bcb8-4e4bcb180f31 None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.152951 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67648f4e-1796-413f-8c32-3937ee9a92cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.153674 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67648f4e-1796-413f-8c32-3937ee9a92cf admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.153955 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67648f4e-1796-413f-8c32-3937ee9a92cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.154230 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67648f4e-1796-413f-8c32-3937ee9a92cf admin admin] PATH_INFO: `/v3/domains` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.154885 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67648f4e-1796-413f-8c32-3937ee9a92cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88128) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 04 09:02:27.155189 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67648f4e-1796-413f-8c32-3937ee9a92cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.156813 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67648f4e-1796-413f-8c32-3937ee9a92cf admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.171969 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1452/2921] 10.222.0.25 () {58 vars in 1153 bytes} [Tue Oct 4 09:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 04 09:02:27.172908 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f67338-104c-4bb7-a253-3ea01c585a83 None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.182437 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f67338-104c-4bb7-a253-3ea01c585a83 None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.187121 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05209-d6ba-426b-8090-30f9fbdfff47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.187742 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05209-d6ba-426b-8090-30f9fbdfff47 admin admin] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.188027 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05209-d6ba-426b-8090-30f9fbdfff47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.188303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db05209-d6ba-426b-8090-30f9fbdfff47 admin admin] PATH_INFO: `/v3/projects` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.189282 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db05209-d6ba-426b-8090-30f9fbdfff47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.190820 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db05209-d6ba-426b-8090-30f9fbdfff47 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.288303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1470/2922] 10.222.0.25 () {60 vars in 1153 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:27.292642 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67648f4e-1796-413f-8c32-3937ee9a92cf admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.304823 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67648f4e-1796-413f-8c32-3937ee9a92cf admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.363235 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b00b-038a-4b7f-94e6-ce19c0476cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.363832 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b00b-038a-4b7f-94e6-ce19c0476cea admin admin] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.364624 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b00b-038a-4b7f-94e6-ce19c0476cea admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.364902 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b00b-038a-4b7f-94e6-ce19c0476cea admin admin] PATH_INFO: `/v3/users` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.365547 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133b00b-038a-4b7f-94e6-ce19c0476cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.367445 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0133b00b-038a-4b7f-94e6-ce19c0476cea admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.377224 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:27.486207 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1453/2923] 10.222.0.25 () {60 vars in 1144 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 04 09:02:27.490942 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05209-d6ba-426b-8090-30f9fbdfff47 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.501082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db05209-d6ba-426b-8090-30f9fbdfff47 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.505723 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d5e5e-03d5-4d0d-a348-38456ac53041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.506322 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d5e5e-03d5-4d0d-a348-38456ac53041 admin admin] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.506631 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d5e5e-03d5-4d0d-a348-38456ac53041 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.506902 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d5e5e-03d5-4d0d-a348-38456ac53041 admin admin] PATH_INFO: `/v3/roles` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.507600 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d5e5e-03d5-4d0d-a348-38456ac53041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.509219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d5e5e-03d5-4d0d-a348-38456ac53041 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.523032 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1471/2924] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:27.523827 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b00b-038a-4b7f-94e6-ce19c0476cea admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.533822 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b00b-038a-4b7f-94e6-ce19c0476cea admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.539075 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0de3a-81f6-427d-9855-da3424f23f9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.539707 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0de3a-81f6-427d-9855-da3424f23f9c admin admin] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.539993 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0de3a-81f6-427d-9855-da3424f23f9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.540273 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0de3a-81f6-427d-9855-da3424f23f9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.540928 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0de3a-81f6-427d-9855-da3424f23f9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.542511 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0de3a-81f6-427d-9855-da3424f23f9c admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.554892 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1454/2925] 10.222.0.25 () {58 vars in 1122 bytes} [Tue Oct 4 09:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 04 09:02:27.561401 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d5e5e-03d5-4d0d-a348-38456ac53041 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.571339 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d5e5e-03d5-4d0d-a348-38456ac53041 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.576454 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490459d-b3db-460f-b819-1145bf60bbf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.577011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490459d-b3db-460f-b819-1145bf60bbf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.577300 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490459d-b3db-460f-b819-1145bf60bbf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.577577 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490459d-b3db-460f-b819-1145bf60bbf3 admin admin] PATH_INFO: `/v3/projects/da9d6a5af9684a63ba6e144e7e56e474/users/07deec11b8824987b1ba152efffeae0e/roles/6fb126c9acf74dc9812a7bbcd5b196db` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.597447 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490459d-b3db-460f-b819-1145bf60bbf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9d6a5af9684a63ba6e144e7e56e474, user_id=07deec11b8824987b1ba152efffeae0e, role_id=6fb126c9acf74dc9812a7bbcd5b196db)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.600812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d490459d-b3db-460f-b819-1145bf60bbf3 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.675759 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1472/2926] 10.222.0.25 () {60 vars in 1483 bytes} [Tue Oct 4 09:02:27 2022] PUT /identity/v3/projects/da9d6a5af9684a63ba6e144e7e56e474/users/07deec11b8824987b1ba152efffeae0e/roles/6fb126c9acf74dc9812a7bbcd5b196db => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 04 09:02:27.688369 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40155c-f748-4da7-bc6b-e8848d14deca None None] REQUEST_METHOD: `POST` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.688663 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40155c-f748-4da7-bc6b-e8848d14deca None None] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.688941 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a40155c-f748-4da7-bc6b-e8848d14deca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.718409 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.auth.core [None req-1a40155c-f748-4da7-bc6b-e8848d14deca None None] MFA Rules not processed for user `07deec11b8824987b1ba152efffeae0e`. Rule list: `[]` (Enabled: `True`). {{(pid=88128) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:27.719673 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-1a40155c-f748-4da7-bc6b-e8848d14deca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.789814 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1455/2927] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:27.801980 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490459d-b3db-460f-b819-1145bf60bbf3 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.803779 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-d490459d-b3db-460f-b819-1145bf60bbf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:27.864219 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d490459d-b3db-460f-b819-1145bf60bbf3 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.867874 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e3985-226e-44bd-85a0-f6e0bb9383f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f4df3626bdb4e3a88ce27eaabf4ca1f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.868473 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e3985-226e-44bd-85a0-f6e0bb9383f6 service cinder] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.868755 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e3985-226e-44bd-85a0-f6e0bb9383f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.869028 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e3985-226e-44bd-85a0-f6e0bb9383f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.874082 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:27.877651 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e3985-226e-44bd-85a0-f6e0bb9383f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.879011 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e3985-226e-44bd-85a0-f6e0bb9383f6 service cinder] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:27.887691 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1473/2928] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:27.908533 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40155c-f748-4da7-bc6b-e8848d14deca None None] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:27.972618 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a40155c-f748-4da7-bc6b-e8848d14deca None None] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:27.978120 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:27.978748 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:27.979031 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:27.979309 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] PATH_INFO: `/v3/users/07deec11b8824987b1ba152efffeae0e` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:27.980468 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07deec11b8824987b1ba152efffeae0e)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:27.982376 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.179255 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07deec11b8824987b1ba152efffeae0e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.186465 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07deec11b8824987b1ba152efffeae0e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.187206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07deec11b8824987b1ba152efffeae0e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.187869 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07deec11b8824987b1ba152efffeae0e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.269220 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07deec11b8824987b1ba152efffeae0e'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:28.278206 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:INSERT=2,keystone:SELECT=89,keystone:DELETE=9 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:28.288205 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1456/2929] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:02:27 2022] DELETE /identity/v3/users/07deec11b8824987b1ba152efffeae0e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:28.292661 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c482c27-36dc-4035-9066-aaad598fd5ae None None] REQUEST_METHOD: `POST` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.292948 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c482c27-36dc-4035-9066-aaad598fd5ae None None] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.293218 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c482c27-36dc-4035-9066-aaad598fd5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.311446 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.auth.core [None req-1c482c27-36dc-4035-9066-aaad598fd5ae None None] MFA Rules not processed for user `6544ace43e54452fa059337ba0542217`. Rule list: `[]` (Enabled: `True`). {{(pid=88127) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 04 09:02:28.312677 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1c482c27-36dc-4035-9066-aaad598fd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:28.373277 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1474/2930] 10.222.0.25 () {58 vars in 958 bytes} [Tue Oct 4 09:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 04 09:02:28.383611 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.385061 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:28.444157 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746daf19-4c83-4c2b-97c2-eb579df00aa0 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.447828 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd1f44-f9bb-4223-b9ff-893386178f27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a269743c34bc48edaab5c0e3e78074c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.448442 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd1f44-f9bb-4223-b9ff-893386178f27 service neutron] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.448724 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd1f44-f9bb-4223-b9ff-893386178f27 service neutron] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.449001 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fd1f44-f9bb-4223-b9ff-893386178f27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.458461 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd1f44-f9bb-4223-b9ff-893386178f27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.459927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fd1f44-f9bb-4223-b9ff-893386178f27 service neutron] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.469332 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1457/2931] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:02:28.859125 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c482c27-36dc-4035-9066-aaad598fd5ae None None] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:02:28.862341 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1c482c27-36dc-4035-9066-aaad598fd5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:02:28.873002 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c482c27-36dc-4035-9066-aaad598fd5ae None None] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:02:28.877812 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:02:28.878449 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:02:28.878728 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:02:28.879003 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] PATH_INFO: `/v3/projects/da9d6a5af9684a63ba6e144e7e56e474` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:02:28.880175 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9d6a5af9684a63ba6e144e7e56e474)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:02:28.882094 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:02:28.966068 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9d6a5af9684a63ba6e144e7e56e474', 'request_id': 'req-fc36800c-8645-4416-88d5-55f727ac4aba'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:29.022863 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9d6a5af9684a63ba6e144e7e56e474', 'request_id': 'req-fc36800c-8645-4416-88d5-55f727ac4aba'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:29.029067 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9d6a5af9684a63ba6e144e7e56e474', 'request_id': 'req-fc36800c-8645-4416-88d5-55f727ac4aba'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:29.039865 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] The token cache is being invalidate because project da9d6a5af9684a63ba6e144e7e56e474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88127) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:02:29.040158 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:29.040791 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:02:29.042293 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1475/2932] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:02:28 2022] DELETE /identity/v3/projects/da9d6a5af9684a63ba6e144e7e56e474 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:02:38.465144 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=29,keystone:DELETE=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:02:39.036844 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:46.059308 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd1f44-f9bb-4223-b9ff-893386178f27 service neutron] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:46.060820 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-31fd1f44-f9bb-4223-b9ff-893386178f27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:46.156849 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fd1f44-f9bb-4223-b9ff-893386178f27 service neutron] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:46.221165 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:46.221884 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:46.222242 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:46.222592 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:46.225151 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:46.237855 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:46.239580 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:46.250585 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1458/2933] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:48.542867 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:48.544618 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:48.560978 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc36800c-8645-4416-88d5-55f727ac4aba admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:48.566451 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e05901861bc34c2398ec600150296657', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:48.567048 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:48.567332 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:48.567638 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:48.569905 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:48.582453 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:48.584119 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:48.594672 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1476/2934] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:53.679439 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:53.680927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:53.750450 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cb761-5e0a-45dd-abd9-3bfbd3cdb837 service nova] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:53.755683 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda0d47-8271-448c-9600-cbab15d8ff34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:53.756291 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0d47-8271-448c-9600-cbab15d8ff34 service placement] REQUEST_METHOD: `GET` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:53.756601 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0d47-8271-448c-9600-cbab15d8ff34 service placement] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:53.756876 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cda0d47-8271-448c-9600-cbab15d8ff34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:53.758633 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-9cda0d47-8271-448c-9600-cbab15d8ff34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:53.769989 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda0d47-8271-448c-9600-cbab15d8ff34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:53.771584 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cda0d47-8271-448c-9600-cbab15d8ff34 service placement] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:53.782057 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1459/2935] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:03:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:03:57.493511 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:57.495014 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:57.558933 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc25ad-03d4-48e6-b2bc-930ee7da9eeb service nova] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:57.563382 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:57.564034 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:57.564318 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:57.564593 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] PATH_INFO: `/v3/users/7fabfe9cbd604b2dac80959b5ee73880` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:57.565734 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7fabfe9cbd604b2dac80959b5ee73880)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:57.567713 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:57.706488 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7fabfe9cbd604b2dac80959b5ee73880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:57.713383 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7fabfe9cbd604b2dac80959b5ee73880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:57.714089 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7fabfe9cbd604b2dac80959b5ee73880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:57.714695 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7fabfe9cbd604b2dac80959b5ee73880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:57.777934 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7fabfe9cbd604b2dac80959b5ee73880'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:57.797830 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1477/2936] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:57 2022] DELETE /identity/v3/users/7fabfe9cbd604b2dac80959b5ee73880 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:58.031395 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda0d47-8271-448c-9600-cbab15d8ff34 service placement] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:58.043603 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cda0d47-8271-448c-9600-cbab15d8ff34 service placement] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:58.052593 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=100 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:58.101660 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:58.102287 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:58.102566 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:58.102840 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] PATH_INFO: `/v3/projects/2e9f862941bd43c0a6de2d8bad2f3d2d` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:58.103972 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e9f862941bd43c0a6de2d8bad2f3d2d)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:58.105863 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:58.194854 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e9f862941bd43c0a6de2d8bad2f3d2d', 'request_id': 'req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.234959 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e9f862941bd43c0a6de2d8bad2f3d2d', 'request_id': 'req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.241286 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e9f862941bd43c0a6de2d8bad2f3d2d', 'request_id': 'req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.251315 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] The token cache is being invalidate because project 2e9f862941bd43c0a6de2d8bad2f3d2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:58.251652 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.252277 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.253731 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1460/2937] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:58 2022] DELETE /identity/v3/projects/2e9f862941bd43c0a6de2d8bad2f3d2d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:58.257730 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:58.259106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:58.271921 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba29b79-a507-4bc2-a305-b095fc180c71 admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:58.329797 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:58.330344 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:58.330627 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:58.330911 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] PATH_INFO: `/v3/users/bef31f96370945a28f2958c30b631798` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:58.332057 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bef31f96370945a28f2958c30b631798)` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:58.333957 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:58.339622 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:58.505616 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bef31f96370945a28f2958c30b631798'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.513042 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bef31f96370945a28f2958c30b631798'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.513692 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bef31f96370945a28f2958c30b631798'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.514303 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bef31f96370945a28f2958c30b631798'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.572349 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.notifications [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bef31f96370945a28f2958c30b631798'} {{(pid=88127) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:58.591335 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1478/2938] 10.222.0.25 () {58 vars in 1224 bytes} [Tue Oct 4 09:03:58 2022] DELETE /identity/v3/users/bef31f96370945a28f2958c30b631798 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:03:58.820146 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] Authenticating user token {{(pid=88128) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:03:58.821881 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.fernet_utils [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88128) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:03:58.834927 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d450a9cf-7dd0-413e-b5ce-3cf117459ae7 admin admin] Validating token access rules against request {{(pid=88128) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:03:58.893216 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6544ace43e54452fa059337ba0542217', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '13165a830a7a4a8b85146503c9ccfc33', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88128) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:03:58.893847 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:03:58.894127 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:03:58.894398 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] PATH_INFO: `/v3/projects/98cf1e0cbe7a4f2c927059a019860ae2` {{(pid=88128) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:03:58.895531 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98cf1e0cbe7a4f2c927059a019860ae2)` {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:03:58.897424 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] RBAC: Authorization granted {{(pid=88128) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:03:58.992793 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:03:58.995664 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98cf1e0cbe7a4f2c927059a019860ae2', 'request_id': 'req-5c550863-a0f7-45d2-9938-4e89d27bd748'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:59.041239 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98cf1e0cbe7a4f2c927059a019860ae2', 'request_id': 'req-5c550863-a0f7-45d2-9938-4e89d27bd748'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:59.047878 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98cf1e0cbe7a4f2c927059a019860ae2', 'request_id': 'req-5c550863-a0f7-45d2-9938-4e89d27bd748'} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:59.058637 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] The token cache is being invalidate because project 98cf1e0cbe7a4f2c927059a019860ae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88128) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 04 09:03:59.058922 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:59.059632 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG keystone.notifications [None req-5c550863-a0f7-45d2-9938-4e89d27bd748 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88128) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 04 09:03:59.061115 dv-cinder-859447-2-smb devstack@keystone.service[88128]: [pid: 88128|app: 0|req: 1461/2939] 10.222.0.25 () {58 vars in 1233 bytes} [Tue Oct 4 09:03:58 2022] DELETE /identity/v3/projects/98cf1e0cbe7a4f2c927059a019860ae2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 04 09:04:08.587673 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:04:09.263987 dv-cinder-859447-2-smb devstack@keystone.service[88128]: DEBUG dbcounter [-] [88128] Writing DB stats keystone:DELETE=4,keystone:SELECT=7,keystone:INSERT=1 {{(pid=88128) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 04 09:05:56.368613 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] Authenticating user token {{(pid=88127) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 04 09:05:56.370021 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:56.437855 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636f3da7-46b6-4864-a2dc-21fe1e22fb2f admin admin] Validating token access rules against request {{(pid=88127) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 04 09:05:56.496106 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adb6e2c-c8f6-491d-b50f-d55a5af5e785 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22aa2b6e4b854de4868b75cc9626b8e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3ad72f0d57a34795921cf5f09b2b63b4', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88127) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 04 09:05:56.496708 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb6e2c-c8f6-491d-b50f-d55a5af5e785 service placement] REQUEST_METHOD: `GET` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 04 09:05:56.496993 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb6e2c-c8f6-491d-b50f-d55a5af5e785 service placement] SCRIPT_NAME: `/identity` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 04 09:05:56.497273 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adb6e2c-c8f6-491d-b50f-d55a5af5e785 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88127) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 04 09:05:56.498998 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.fernet_utils [None req-8adb6e2c-c8f6-491d-b50f-d55a5af5e785 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88127) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 04 09:05:56.510039 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb6e2c-c8f6-491d-b50f-d55a5af5e785 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 04 09:05:56.511670 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adb6e2c-c8f6-491d-b50f-d55a5af5e785 service placement] RBAC: Authorization granted {{(pid=88127) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 04 09:05:56.521926 dv-cinder-859447-2-smb devstack@keystone.service[88127]: [pid: 88127|app: 0|req: 1479/2940] 10.222.0.25 () {60 vars in 1365 bytes} [Tue Oct 4 09:05:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 04 09:06:06.517184 dv-cinder-859447-2-smb devstack@keystone.service[88127]: DEBUG dbcounter [-] [88127] Writing DB stats keystone:SELECT=58 {{(pid=88127) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}